/var/lib/scrapydweb/data/history_log/timer_tasks_history.log ################################################## [2025-06-27 14:54:35,889] WARNING in apscheduler: Add task #22 (bca_logged_out.es) successfully, next run at 2025-06-27 17:00:00+00:00. [2025-06-27 14:54:35,890] WARNING in apscheduler: Added job_instance: { "id": "22", "kwargs": { "task_id": 22 }, "max_instances": 1, "misfire_grace_time": 600, "name": "bca_logged_out.es", "next_run_time": "datetime.datetime(2025, 6, 27, 17, 0, tzinfo=)", "trigger": "" } [2025-06-30 09:02:04,003] WARNING in apscheduler: Add task #23 (bca_logged_out.es) successfully, next run at 2025-06-30 10:00:00+00:00. [2025-06-30 09:02:04,003] WARNING in apscheduler: Added job_instance: { "id": "23", "kwargs": { "task_id": 23 }, "max_instances": 1, "misfire_grace_time": 600, "name": "bca_logged_out.es", "next_run_time": "datetime.datetime(2025, 6, 30, 10, 0, tzinfo=)", "trigger": "" } [2025-06-30 09:02:07,774] WARNING in apscheduler: Fail to execute task #23 (bca_logged_out.es) on node 1, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2025-06-30 09:02:10,787] ERROR in apscheduler: Fail to execute task #23 (bca_logged_out.es) on node 1, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2025-06-30 09:02:41,045] WARNING in apscheduler: EVENT_JOB_REMOVED: {'alias': None, 'code': 1024, 'job_id': '22', 'jobstore': 'default'} [2025-06-30 09:02:47,003] WARNING in apscheduler: Task #22 deleted. [2025-06-30 09:03:31,135] WARNING in apscheduler: Add task #24 (bca_logged_out.it) successfully, next run at 2025-06-30 10:00:00+00:00. [2025-06-30 09:03:31,135] WARNING in apscheduler: Added job_instance: { "id": "24", "kwargs": { "task_id": 24 }, "max_instances": 1, "misfire_grace_time": 600, "name": "bca_logged_out.it", "next_run_time": "datetime.datetime(2025, 6, 30, 10, 0, tzinfo=)", "trigger": "" } [2025-06-30 09:04:55,915] WARNING in apscheduler: Add task #25 (auto1.es) successfully, next run at 2025-06-30 10:00:00+00:00. [2025-06-30 09:04:55,915] WARNING in apscheduler: Added job_instance: { "id": "25", "kwargs": { "task_id": 25 }, "max_instances": 1, "misfire_grace_time": 600, "name": "auto1.es", "next_run_time": "datetime.datetime(2025, 6, 30, 10, 0, tzinfo=)", "trigger": "" } [2025-06-30 09:06:36,670] WARNING in apscheduler: Add task #26 (adesa.it) successfully, next run at 2025-06-30 10:00:00+00:00. [2025-06-30 09:06:36,671] WARNING in apscheduler: Added job_instance: { "id": "26", "kwargs": { "task_id": 26 }, "max_instances": 1, "misfire_grace_time": 600, "name": "adesa.it", "next_run_time": "datetime.datetime(2025, 6, 30, 10, 0, tzinfo=)", "trigger": "" } [2025-06-30 09:09:51,924] WARNING in apscheduler: Add task #27 (adesa.be) successfully, next run at 2025-06-30 10:00:00+00:00. [2025-06-30 09:09:51,924] WARNING in apscheduler: Added job_instance: { "id": "27", "kwargs": { "task_id": 27 }, "max_instances": 1, "misfire_grace_time": 600, "name": "adesa.be", "next_run_time": "datetime.datetime(2025, 6, 30, 10, 0, tzinfo=)", "trigger": "" } [2025-06-30 09:11:49,752] WARNING in apscheduler: Add task #28 (autorola_logged_out.es) successfully, next run at 2025-06-30 10:30:00+00:00. [2025-06-30 09:11:49,753] WARNING in apscheduler: Added job_instance: { "id": "28", "kwargs": { "task_id": 28 }, "max_instances": 1, "misfire_grace_time": 600, "name": "autorola_logged_out.es", "next_run_time": "datetime.datetime(2025, 6, 30, 10, 30, tzinfo=)", "trigger": "" } [2025-06-30 09:13:45,267] WARNING in apscheduler: Add task #29 (autorola.it) successfully, next run at 2025-06-30 10:00:00+00:00. [2025-06-30 09:13:45,267] WARNING in apscheduler: Added job_instance: { "id": "29", "kwargs": { "task_id": 29 }, "max_instances": 1, "misfire_grace_time": 600, "name": "autorola.it", "next_run_time": "datetime.datetime(2025, 6, 30, 10, 0, tzinfo=)", "trigger": "" } [2025-06-30 09:13:51,357] WARNING in apscheduler: EVENT_JOB_REMOVED: {'alias': None, 'code': 1024, 'job_id': '29', 'jobstore': 'default'} [2025-06-30 09:13:56,768] WARNING in apscheduler: Task #29 deleted. [2025-06-30 09:14:52,954] WARNING in apscheduler: Add task #29 (autorola_logged_out.it) successfully, next run at 2025-06-30 10:20:00+00:00. [2025-06-30 09:14:52,955] WARNING in apscheduler: Added job_instance: { "id": "29", "kwargs": { "task_id": 29 }, "max_instances": 1, "misfire_grace_time": 600, "name": "autorola_logged_out.it", "next_run_time": "datetime.datetime(2025, 6, 30, 10, 20, tzinfo=)", "trigger": "" } [2025-06-30 09:16:09,180] WARNING in apscheduler: Add task #30 (openlane.gb) successfully, next run at 2025-06-30 10:00:00+00:00. [2025-06-30 09:16:09,181] WARNING in apscheduler: Added job_instance: { "id": "30", "kwargs": { "task_id": 30 }, "max_instances": 1, "misfire_grace_time": 600, "name": "openlane.gb", "next_run_time": "datetime.datetime(2025, 6, 30, 10, 0, tzinfo=)", "trigger": "" } [2025-06-30 09:16:15,854] WARNING in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-06-30 09:16:18,883] ERROR in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-06-30 09:16:23,384] WARNING in apscheduler: Fail to execute task #28 (autorola_logged_out.es) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-06-30 09:16:26,398] ERROR in apscheduler: Fail to execute task #28 (autorola_logged_out.es) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-06-30 09:17:15,439] WARNING in apscheduler: Add task #31 (auto1.es) successfully, next run at 2025-06-30 23:00:00+00:00. [2025-06-30 09:17:15,440] WARNING in apscheduler: Added job_instance: { "id": "31", "kwargs": { "task_id": 31 }, "max_instances": 1, "misfire_grace_time": 600, "name": "auto1.es", "next_run_time": "datetime.datetime(2025, 6, 30, 23, 0, tzinfo=)", "trigger": "" } [2025-06-30 09:17:22,811] WARNING in apscheduler: Fail to execute task #31 (auto1.es) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-06-30 09:17:25,826] ERROR in apscheduler: Fail to execute task #31 (auto1.es) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-06-30 09:19:47,403] WARNING in apscheduler: Add task #32 (vpauto.fr) successfully, next run at 2025-06-30 10:00:00+00:00. [2025-06-30 09:19:47,404] WARNING in apscheduler: Added job_instance: { "id": "32", "kwargs": { "task_id": 32 }, "max_instances": 1, "misfire_grace_time": 600, "name": "vpauto.fr", "next_run_time": "datetime.datetime(2025, 6, 30, 10, 0, tzinfo=)", "trigger": "" } [2025-06-30 09:21:37,793] WARNING in apscheduler: Add task #33 (bca_logged_out.it) successfully, next run at 2025-06-30 10:00:00+00:00. [2025-06-30 09:21:37,795] WARNING in apscheduler: Added job_instance: { "id": "33", "kwargs": { "task_id": 33 }, "max_instances": 1, "misfire_grace_time": 600, "name": "bca_logged_out.it", "next_run_time": "datetime.datetime(2025, 6, 30, 10, 0, tzinfo=)", "trigger": "" } [2025-06-30 09:21:52,825] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-06-30 09:21:55,838] ERROR in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-06-30 09:23:10,259] WARNING in apscheduler: Add task #34 (bleeker_en_de_jong.nl) successfully, next run at 2025-06-30 10:00:00+00:00. [2025-06-30 09:23:10,260] WARNING in apscheduler: Added job_instance: { "id": "34", "kwargs": { "task_id": 34 }, "max_instances": 1, "misfire_grace_time": 600, "name": "bleeker_en_de_jong.nl", "next_run_time": "datetime.datetime(2025, 6, 30, 10, 0, tzinfo=)", "trigger": "" } [2025-06-30 09:23:16,261] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-06-30 09:23:19,278] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-06-30 09:24:57,760] WARNING in apscheduler: Add task #35 (auto1.it) successfully, next run at 2025-06-30 10:00:00+00:00. [2025-06-30 09:24:57,761] WARNING in apscheduler: Added job_instance: { "id": "35", "kwargs": { "task_id": 35 }, "max_instances": 1, "misfire_grace_time": 600, "name": "auto1.it", "next_run_time": "datetime.datetime(2025, 6, 30, 10, 0, tzinfo=)", "trigger": "" } [2025-06-30 09:28:45,928] WARNING in apscheduler: Add task #36 (astonbarclay.gb) successfully, next run at 2025-06-30 19:00:00+00:00. [2025-06-30 09:28:45,928] WARNING in apscheduler: Added job_instance: { "id": "36", "kwargs": { "task_id": 36 }, "max_instances": 1, "misfire_grace_time": 600, "name": "astonbarclay.gb", "next_run_time": "datetime.datetime(2025, 6, 30, 19, 0, tzinfo=)", "trigger": "" } [2025-06-30 09:30:14,713] WARNING in apscheduler: Add task #37 (manheim.gb) successfully, next run at 2025-06-30 10:00:00+00:00. [2025-06-30 09:30:14,714] WARNING in apscheduler: Added job_instance: { "id": "37", "kwargs": { "task_id": 37 }, "max_instances": 1, "misfire_grace_time": 600, "name": "manheim.gb", "next_run_time": "datetime.datetime(2025, 6, 30, 10, 0, tzinfo=)", "trigger": "" } [2025-06-30 09:31:24,671] WARNING in apscheduler: Add task #38 (bca.uk) successfully, next run at 2025-06-30 11:20:00+00:00. [2025-06-30 09:31:24,671] WARNING in apscheduler: Added job_instance: { "id": "38", "kwargs": { "task_id": 38 }, "max_instances": 1, "misfire_grace_time": 600, "name": "bca.uk", "next_run_time": "datetime.datetime(2025, 6, 30, 11, 20, tzinfo=)", "trigger": "" } [2025-06-30 09:45:28,207] WARNING in apscheduler: Add task #39 (ecarstrade.be) successfully, next run at 2025-06-30 15:00:00+00:00. [2025-06-30 09:45:28,208] WARNING in apscheduler: Added job_instance: { "id": "39", "kwargs": { "task_id": 39 }, "max_instances": 1, "misfire_grace_time": 600, "name": "ecarstrade.be", "next_run_time": "datetime.datetime(2025, 6, 30, 15, 0, tzinfo=)", "trigger": "" } [2025-06-30 09:46:07,636] WARNING in apscheduler: Add task #40 (ecarstrade.de) successfully, next run at 2025-06-30 20:30:00+00:00. [2025-06-30 09:46:07,637] WARNING in apscheduler: Added job_instance: { "id": "40", "kwargs": { "task_id": 40 }, "max_instances": 1, "misfire_grace_time": 600, "name": "ecarstrade.de", "next_run_time": "datetime.datetime(2025, 6, 30, 20, 30, tzinfo=)", "trigger": "" } [2025-06-30 09:46:50,950] WARNING in apscheduler: Add task #41 (ecarstrade.nl) successfully, next run at 2025-06-30 17:00:00+00:00. [2025-06-30 09:46:50,952] WARNING in apscheduler: Added job_instance: { "id": "41", "kwargs": { "task_id": 41 }, "max_instances": 1, "misfire_grace_time": 600, "name": "ecarstrade.nl", "next_run_time": "datetime.datetime(2025, 6, 30, 17, 0, tzinfo=)", "trigger": "" } [2025-06-30 09:48:03,372] WARNING in apscheduler: Add task #42 (synter.gb) successfully, next run at 2025-06-30 10:00:00+00:00. [2025-06-30 09:48:03,374] WARNING in apscheduler: Added job_instance: { "id": "42", "kwargs": { "task_id": 42 }, "max_instances": 1, "misfire_grace_time": 600, "name": "synter.gb", "next_run_time": "datetime.datetime(2025, 6, 30, 10, 0, tzinfo=)", "trigger": "" } [2025-06-30 09:49:15,393] WARNING in apscheduler: Add task #43 (autobuy.fr) successfully, next run at 2025-06-30 23:00:00+00:00. [2025-06-30 09:49:15,393] WARNING in apscheduler: Added job_instance: { "id": "43", "kwargs": { "task_id": 43 }, "max_instances": 1, "misfire_grace_time": 600, "name": "autobuy.fr", "next_run_time": "datetime.datetime(2025, 6, 30, 23, 0, tzinfo=)", "trigger": "" } [2025-06-30 09:52:01,396] WARNING in apscheduler: Add task #44 (motorway.uk) successfully, next run at 2025-06-30 10:00:00+00:00. [2025-06-30 09:52:01,397] WARNING in apscheduler: Added job_instance: { "id": "44", "kwargs": { "task_id": 44 }, "max_instances": 1, "misfire_grace_time": 600, "name": "motorway.uk", "next_run_time": "datetime.datetime(2025, 6, 30, 10, 0, tzinfo=)", "trigger": "" } [2025-06-30 09:52:10,558] WARNING in apscheduler: Fail to execute task #43 (autobuy.fr) on node 1, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autobuy.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2025-06-30 09:52:13,576] ERROR in apscheduler: Fail to execute task #43 (autobuy.fr) on node 1, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autobuy.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2025-06-30 10:00:00,705] WARNING in apscheduler: Fail to execute task #30 (openlane.gb) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'openlane.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-06-30 10:00:00,850] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-06-30 10:00:01,007] WARNING in apscheduler: Fail to execute task #26 (adesa.it) on node 1, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'adesa.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2025-06-30 10:00:01,045] WARNING in apscheduler: Fail to execute task #42 (synter.gb) on node 1, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'sytner.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2025-06-30 10:00:01,065] WARNING in apscheduler: Fail to execute task #27 (adesa.be) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'adesa.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-06-30 10:00:01,317] WARNING in apscheduler: Fail to execute task #35 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-06-30 10:00:01,586] WARNING in apscheduler: Fail to execute task #44 (motorway.uk) on node 1, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'motorway.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2025-06-30 10:00:03,743] ERROR in apscheduler: Fail to execute task #30 (openlane.gb) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'openlane.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-06-30 10:00:03,879] ERROR in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-06-30 10:00:04,044] ERROR in apscheduler: Fail to execute task #26 (adesa.it) on node 1, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'adesa.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2025-06-30 10:00:04,117] ERROR in apscheduler: Fail to execute task #27 (adesa.be) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'adesa.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-06-30 10:00:04,126] ERROR in apscheduler: Fail to execute task #42 (synter.gb) on node 1, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'sytner.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2025-06-30 10:00:04,395] ERROR in apscheduler: Fail to execute task #35 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-06-30 10:00:04,614] ERROR in apscheduler: Fail to execute task #44 (motorway.uk) on node 1, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'motorway.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2025-06-30 10:04:53,596] WARNING in apscheduler: Add task #45 (carwow.gb) successfully, next run at 2025-07-01 06:00:00+00:00. [2025-06-30 10:04:53,596] WARNING in apscheduler: Added job_instance: { "id": "45", "kwargs": { "task_id": 45 }, "max_instances": 1, "misfire_grace_time": 600, "name": "carwow.gb", "next_run_time": "datetime.datetime(2025, 7, 1, 6, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:17:11,432] WARNING in apscheduler: Add task #46 (autorola_logged_out.se) successfully, next run at 2025-06-30 11:00:00+00:00. [2025-06-30 10:17:11,433] WARNING in apscheduler: Added job_instance: { "id": "46", "kwargs": { "task_id": 46 }, "max_instances": 1, "misfire_grace_time": 600, "name": "autorola_logged_out.se", "next_run_time": "datetime.datetime(2025, 6, 30, 11, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:17:45,785] WARNING in apscheduler: Add task #47 (autorola_logged_out.pt) successfully, next run at 2025-06-30 21:00:00+00:00. [2025-06-30 10:17:45,785] WARNING in apscheduler: Added job_instance: { "id": "47", "kwargs": { "task_id": 47 }, "max_instances": 1, "misfire_grace_time": 600, "name": "autorola_logged_out.pt", "next_run_time": "datetime.datetime(2025, 6, 30, 21, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:18:18,050] WARNING in apscheduler: Add task #48 (autorola_logged_out.pl) successfully, next run at 2025-06-30 21:00:00+00:00. [2025-06-30 10:18:18,050] WARNING in apscheduler: Added job_instance: { "id": "48", "kwargs": { "task_id": 48 }, "max_instances": 1, "misfire_grace_time": 600, "name": "autorola_logged_out.pl", "next_run_time": "datetime.datetime(2025, 6, 30, 21, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:19:08,416] WARNING in apscheduler: Add task #49 (autorola_logged_out.nl) successfully, next run at 2025-06-30 21:00:00+00:00. [2025-06-30 10:19:08,416] WARNING in apscheduler: Added job_instance: { "id": "49", "kwargs": { "task_id": 49 }, "max_instances": 1, "misfire_grace_time": 600, "name": "autorola_logged_out.nl", "next_run_time": "datetime.datetime(2025, 6, 30, 21, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:19:48,744] WARNING in apscheduler: Add task #50 (autorola_logged_out.it) successfully, next run at 2025-06-30 21:00:00+00:00. [2025-06-30 10:19:48,745] WARNING in apscheduler: Added job_instance: { "id": "50", "kwargs": { "task_id": 50 }, "max_instances": 1, "misfire_grace_time": 600, "name": "autorola_logged_out.it", "next_run_time": "datetime.datetime(2025, 6, 30, 21, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:20:26,858] WARNING in apscheduler: Add task #51 (autorola_logged_out.fr) successfully, next run at 2025-06-30 21:00:00+00:00. [2025-06-30 10:20:26,859] WARNING in apscheduler: Added job_instance: { "id": "51", "kwargs": { "task_id": 51 }, "max_instances": 1, "misfire_grace_time": 600, "name": "autorola_logged_out.fr", "next_run_time": "datetime.datetime(2025, 6, 30, 21, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:21:10,660] WARNING in apscheduler: Add task #52 (autorola_logged_out.de) successfully, next run at 2025-06-30 21:00:00+00:00. [2025-06-30 10:21:10,662] WARNING in apscheduler: Added job_instance: { "id": "52", "kwargs": { "task_id": 52 }, "max_instances": 1, "misfire_grace_time": 600, "name": "autorola_logged_out.de", "next_run_time": "datetime.datetime(2025, 6, 30, 21, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:21:50,037] WARNING in apscheduler: Add task #53 (autorola_logged_out.be) successfully, next run at 2025-06-30 21:00:00+00:00. [2025-06-30 10:21:50,041] WARNING in apscheduler: Added job_instance: { "id": "53", "kwargs": { "task_id": 53 }, "max_instances": 1, "misfire_grace_time": 600, "name": "autorola_logged_out.be", "next_run_time": "datetime.datetime(2025, 6, 30, 21, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:22:08,290] WARNING in apscheduler: Fail to execute task #50 (autorola_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-06-30 10:22:11,330] ERROR in apscheduler: Fail to execute task #50 (autorola_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-06-30 10:25:00,259] WARNING in apscheduler: Add task #54 (ayvens.es) successfully, next run at 2025-06-30 20:00:00+00:00. [2025-06-30 10:25:00,259] WARNING in apscheduler: Added job_instance: { "id": "54", "kwargs": { "task_id": 54 }, "max_instances": 1, "misfire_grace_time": 600, "name": "ayvens.es", "next_run_time": "datetime.datetime(2025, 6, 30, 20, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:25:29,731] WARNING in apscheduler: Add task #55 (ayvens.be) successfully, next run at 2025-06-30 20:00:00+00:00. [2025-06-30 10:25:29,732] WARNING in apscheduler: Added job_instance: { "id": "55", "kwargs": { "task_id": 55 }, "max_instances": 1, "misfire_grace_time": 600, "name": "ayvens.be", "next_run_time": "datetime.datetime(2025, 6, 30, 20, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:25:59,564] WARNING in apscheduler: Add task #56 (ayvens.de) successfully, next run at 2025-06-30 20:00:00+00:00. [2025-06-30 10:25:59,565] WARNING in apscheduler: Added job_instance: { "id": "56", "kwargs": { "task_id": 56 }, "max_instances": 1, "misfire_grace_time": 600, "name": "ayvens.de", "next_run_time": "datetime.datetime(2025, 6, 30, 20, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:26:30,394] WARNING in apscheduler: Add task #57 (ayvens.fr) successfully, next run at 2025-06-30 20:00:00+00:00. [2025-06-30 10:26:30,395] WARNING in apscheduler: Added job_instance: { "id": "57", "kwargs": { "task_id": 57 }, "max_instances": 1, "misfire_grace_time": 600, "name": "ayvens.fr", "next_run_time": "datetime.datetime(2025, 6, 30, 20, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:27:01,711] WARNING in apscheduler: Add task #58 (ayvens.it) successfully, next run at 2025-06-30 20:00:00+00:00. [2025-06-30 10:27:01,711] WARNING in apscheduler: Added job_instance: { "id": "58", "kwargs": { "task_id": 58 }, "max_instances": 1, "misfire_grace_time": 600, "name": "ayvens.it", "next_run_time": "datetime.datetime(2025, 6, 30, 20, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:27:37,843] WARNING in apscheduler: Add task #59 (ayvens.pl) successfully, next run at 2025-06-30 20:00:00+00:00. [2025-06-30 10:27:37,849] WARNING in apscheduler: Added job_instance: { "id": "59", "kwargs": { "task_id": 59 }, "max_instances": 1, "misfire_grace_time": 600, "name": "ayvens.pl", "next_run_time": "datetime.datetime(2025, 6, 30, 20, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:28:17,412] WARNING in apscheduler: Add task #60 (ayvens.se) successfully, next run at 2025-06-30 20:00:00+00:00. [2025-06-30 10:28:17,413] WARNING in apscheduler: Added job_instance: { "id": "60", "kwargs": { "task_id": 60 }, "max_instances": 1, "misfire_grace_time": 600, "name": "ayvens.se", "next_run_time": "datetime.datetime(2025, 6, 30, 20, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:30:00,126] WARNING in apscheduler: Fail to execute task #28 (autorola_logged_out.es) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-06-30 10:30:03,176] ERROR in apscheduler: Fail to execute task #28 (autorola_logged_out.es) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-06-30 10:31:47,387] WARNING in apscheduler: EVENT_JOB_REMOVED: {'alias': None, 'code': 1024, 'job_id': '57', 'jobstore': 'default'} [2025-06-30 10:32:01,607] WARNING in apscheduler: Task #57 deleted. [2025-06-30 10:32:01,858] WARNING in apscheduler: Task #21 deleted. [2025-06-30 10:32:02,220] WARNING in apscheduler: Task #20 deleted. [2025-06-30 10:32:02,418] WARNING in apscheduler: Task #19 deleted. [2025-06-30 10:32:02,612] WARNING in apscheduler: Task #18 deleted. [2025-06-30 10:32:02,784] WARNING in apscheduler: Task #17 deleted. [2025-06-30 10:32:03,004] WARNING in apscheduler: Task #16 deleted. [2025-06-30 10:32:03,359] WARNING in apscheduler: Task #15 deleted. [2025-06-30 10:32:03,568] WARNING in apscheduler: Task #14 deleted. [2025-06-30 10:32:03,711] WARNING in apscheduler: Task #13 deleted. [2025-06-30 10:32:03,920] WARNING in apscheduler: Task #12 deleted. [2025-06-30 10:32:04,141] WARNING in apscheduler: Task #11 deleted. [2025-06-30 10:32:04,344] WARNING in apscheduler: Task #10 deleted. [2025-06-30 10:32:04,484] WARNING in apscheduler: EVENT_JOB_REMOVED: {'alias': None, 'code': 1024, 'job_id': '23', 'jobstore': 'default'} [2025-06-30 10:32:12,992] WARNING in apscheduler: Task #1 deleted. [2025-06-30 10:32:13,016] WARNING in apscheduler: Task #2 deleted. [2025-06-30 10:32:13,264] WARNING in apscheduler: Task #3 deleted. [2025-06-30 10:32:13,448] WARNING in apscheduler: Task #4 deleted. [2025-06-30 10:32:13,675] WARNING in apscheduler: Task #5 deleted. [2025-06-30 10:32:14,221] WARNING in apscheduler: Task #6 deleted. [2025-06-30 10:32:14,752] WARNING in apscheduler: Task #7 deleted. [2025-06-30 10:32:15,240] WARNING in apscheduler: Task #8 deleted. [2025-06-30 10:32:16,428] WARNING in apscheduler: Task #9 deleted. [2025-06-30 10:32:30,924] WARNING in apscheduler: EVENT_JOB_REMOVED: {'alias': None, 'code': 1024, 'job_id': '24', 'jobstore': 'default'} [2025-06-30 10:32:34,577] WARNING in apscheduler: Task #23 deleted. [2025-06-30 10:32:34,608] WARNING in apscheduler: Task #24 deleted. [2025-06-30 10:32:50,022] WARNING in apscheduler: Update task #33 (bca_logged_out.it) successfully, next run at 2025-06-30 23:00:00+00:00. [2025-06-30 10:32:50,022] WARNING in apscheduler: Updated job_instance: { "id": "33", "kwargs": { "task_id": 33 }, "max_instances": 1, "misfire_grace_time": 600, "name": "bca_logged_out.it", "next_run_time": "datetime.datetime(2025, 6, 30, 23, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:34:23,464] WARNING in apscheduler: Add task #61 (bca_logged_out.es) successfully, next run at 2025-06-30 23:00:00+00:00. [2025-06-30 10:34:23,465] WARNING in apscheduler: Added job_instance: { "id": "61", "kwargs": { "task_id": 61 }, "max_instances": 1, "misfire_grace_time": 600, "name": "bca_logged_out.es", "next_run_time": "datetime.datetime(2025, 6, 30, 23, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:34:59,360] WARNING in apscheduler: Add task #62 (bca_logged_out.fr) successfully, next run at 2025-06-30 23:00:00+00:00. [2025-06-30 10:34:59,361] WARNING in apscheduler: Added job_instance: { "id": "62", "kwargs": { "task_id": 62 }, "max_instances": 1, "misfire_grace_time": 600, "name": "bca_logged_out.fr", "next_run_time": "datetime.datetime(2025, 6, 30, 23, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:35:39,732] WARNING in apscheduler: Add task #63 (bca_logged_out.nl) successfully, next run at 2025-06-30 23:00:00+00:00. [2025-06-30 10:35:39,732] WARNING in apscheduler: Added job_instance: { "id": "63", "kwargs": { "task_id": 63 }, "max_instances": 1, "misfire_grace_time": 600, "name": "bca_logged_out.nl", "next_run_time": "datetime.datetime(2025, 6, 30, 23, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:36:18,336] WARNING in apscheduler: Add task #64 (bca_logged_out.pl) successfully, next run at 2025-06-30 23:00:00+00:00. [2025-06-30 10:36:18,336] WARNING in apscheduler: Added job_instance: { "id": "64", "kwargs": { "task_id": 64 }, "max_instances": 1, "misfire_grace_time": 600, "name": "bca_logged_out.pl", "next_run_time": "datetime.datetime(2025, 6, 30, 23, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:36:53,336] WARNING in apscheduler: Add task #65 (bca_logged_out.pt) successfully, next run at 2025-06-30 21:00:00+00:00. [2025-06-30 10:36:53,339] WARNING in apscheduler: Added job_instance: { "id": "65", "kwargs": { "task_id": 65 }, "max_instances": 1, "misfire_grace_time": 600, "name": "bca_logged_out.pt", "next_run_time": "datetime.datetime(2025, 6, 30, 21, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:37:47,180] WARNING in apscheduler: Add task #66 (bca_logged_out.se) successfully, next run at 2025-06-30 21:00:00+00:00. [2025-06-30 10:37:47,182] WARNING in apscheduler: Added job_instance: { "id": "66", "kwargs": { "task_id": 66 }, "max_instances": 1, "misfire_grace_time": 600, "name": "bca_logged_out.se", "next_run_time": "datetime.datetime(2025, 6, 30, 21, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:40:23,126] WARNING in apscheduler: Add task #67 (bca_logged_out.de) successfully, next run at 2025-06-30 21:00:00+00:00. [2025-06-30 10:40:23,129] WARNING in apscheduler: Added job_instance: { "id": "67", "kwargs": { "task_id": 67 }, "max_instances": 1, "misfire_grace_time": 600, "name": "bca_logged_out.de", "next_run_time": "datetime.datetime(2025, 6, 30, 21, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:41:13,514] WARNING in apscheduler: Add task #68 (bca_logged_out.be) successfully, next run at 2025-06-30 21:00:00+00:00. [2025-06-30 10:41:13,515] WARNING in apscheduler: Added job_instance: { "id": "68", "kwargs": { "task_id": 68 }, "max_instances": 1, "misfire_grace_time": 600, "name": "bca_logged_out.be", "next_run_time": "datetime.datetime(2025, 6, 30, 21, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:45:19,413] WARNING in apscheduler: EVENT_JOB_REMOVED: {'alias': None, 'code': 1024, 'job_id': '55', 'jobstore': 'default'} [2025-06-30 10:45:23,421] WARNING in apscheduler: Task #55 deleted. [2025-06-30 10:45:36,926] WARNING in apscheduler: EVENT_JOB_REMOVED: {'alias': None, 'code': 1024, 'job_id': '64', 'jobstore': 'default'} [2025-06-30 10:45:41,868] WARNING in apscheduler: Task #64 deleted. [2025-06-30 10:45:56,949] WARNING in apscheduler: EVENT_JOB_REMOVED: {'alias': None, 'code': 1024, 'job_id': '65', 'jobstore': 'default'} [2025-06-30 10:46:03,443] WARNING in apscheduler: EVENT_JOB_REMOVED: {'alias': None, 'code': 1024, 'job_id': '35', 'jobstore': 'default'} [2025-06-30 10:46:12,647] WARNING in apscheduler: EVENT_JOB_REMOVED: {'alias': None, 'code': 1024, 'job_id': '27', 'jobstore': 'default'} [2025-06-30 10:46:33,142] WARNING in apscheduler: Task #35 deleted. [2025-06-30 10:46:37,600] WARNING in apscheduler: Task #27 deleted. [2025-06-30 10:46:38,397] WARNING in apscheduler: Task #65 deleted. [2025-06-30 10:46:52,040] WARNING in apscheduler: EVENT_JOB_REMOVED: {'alias': None, 'code': 1024, 'job_id': '68', 'jobstore': 'default'} [2025-06-30 10:47:07,273] WARNING in apscheduler: Task #68 deleted. [2025-06-30 10:47:36,693] WARNING in apscheduler: EVENT_JOB_REMOVED: {'alias': None, 'code': 1024, 'job_id': '67', 'jobstore': 'default'} [2025-06-30 10:47:52,293] WARNING in apscheduler: EVENT_JOB_REMOVED: {'alias': None, 'code': 1024, 'job_id': '66', 'jobstore': 'default'} [2025-06-30 10:48:37,174] WARNING in apscheduler: EVENT_JOB_REMOVED: {'alias': None, 'code': 1024, 'job_id': '61', 'jobstore': 'default'} [2025-06-30 10:48:42,984] WARNING in apscheduler: EVENT_JOB_REMOVED: {'alias': None, 'code': 1024, 'job_id': '59', 'jobstore': 'default'} [2025-06-30 10:49:20,067] WARNING in apscheduler: Update task #66 (bca_logged_out.se) successfully, next run at 2025-06-30 21:00:00+00:00. [2025-06-30 10:49:20,067] WARNING in apscheduler: Updated job_instance: { "id": "66", "kwargs": { "task_id": 66 }, "max_instances": 1, "misfire_grace_time": 600, "name": "bca_logged_out.se", "next_run_time": "datetime.datetime(2025, 6, 30, 21, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:49:36,999] WARNING in apscheduler: Update task #67 (bca_logged_out.de) successfully, next run at 2025-06-30 21:00:00+00:00. [2025-06-30 10:49:37,000] WARNING in apscheduler: Updated job_instance: { "id": "67", "kwargs": { "task_id": 67 }, "max_instances": 1, "misfire_grace_time": 600, "name": "bca_logged_out.de", "next_run_time": "datetime.datetime(2025, 6, 30, 21, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:49:47,669] WARNING in apscheduler: Update task #61 (bca_logged_out.es) successfully, next run at 2025-06-30 23:00:00+00:00. [2025-06-30 10:49:47,670] WARNING in apscheduler: Updated job_instance: { "id": "61", "kwargs": { "task_id": 61 }, "max_instances": 1, "misfire_grace_time": 600, "name": "bca_logged_out.es", "next_run_time": "datetime.datetime(2025, 6, 30, 23, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:49:57,311] WARNING in apscheduler: Update task #59 (ayvens.pl) successfully, next run at 2025-06-30 20:00:00+00:00. [2025-06-30 10:49:57,311] WARNING in apscheduler: Updated job_instance: { "id": "59", "kwargs": { "task_id": 59 }, "max_instances": 1, "misfire_grace_time": 600, "name": "ayvens.pl", "next_run_time": "datetime.datetime(2025, 6, 30, 20, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:51:13,583] WARNING in apscheduler: Add task #68 (6,7,8,9,10,21) successfully, next run at 2025-06-30 11:00:00+00:00. [2025-06-30 10:51:13,583] WARNING in apscheduler: Added job_instance: { "id": "68", "kwargs": { "task_id": 68 }, "max_instances": 1, "misfire_grace_time": 600, "name": "6,7,8,9,10,21", "next_run_time": "datetime.datetime(2025, 6, 30, 11, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:51:38,128] WARNING in apscheduler: Update task #68 (bca_logged_out.pt) successfully, next run at 2025-06-30 21:00:00+00:00. [2025-06-30 10:51:38,128] WARNING in apscheduler: Updated job_instance: { "id": "68", "kwargs": { "task_id": 68 }, "max_instances": 1, "misfire_grace_time": 600, "name": "bca_logged_out.pt", "next_run_time": "datetime.datetime(2025, 6, 30, 21, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:52:25,384] WARNING in apscheduler: Add task #69 (bca_logged_out.pl) successfully, next run at 2025-06-30 21:00:00+00:00. [2025-06-30 10:52:25,384] WARNING in apscheduler: Added job_instance: { "id": "69", "kwargs": { "task_id": 69 }, "max_instances": 1, "misfire_grace_time": 600, "name": "bca_logged_out.pl", "next_run_time": "datetime.datetime(2025, 6, 30, 21, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:53:18,035] WARNING in apscheduler: Add task #70 (bca_logged_out.it) successfully, next run at 2025-06-30 21:00:00+00:00. [2025-06-30 10:53:18,036] WARNING in apscheduler: Added job_instance: { "id": "70", "kwargs": { "task_id": 70 }, "max_instances": 1, "misfire_grace_time": 600, "name": "bca_logged_out.it", "next_run_time": "datetime.datetime(2025, 6, 30, 21, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:55:06,345] WARNING in apscheduler: Add task #71 (bca_logged_out.be) successfully, next run at 2025-06-30 21:00:00+00:00. [2025-06-30 10:55:06,345] WARNING in apscheduler: Added job_instance: { "id": "71", "kwargs": { "task_id": 71 }, "max_instances": 1, "misfire_grace_time": 600, "name": "bca_logged_out.be", "next_run_time": "datetime.datetime(2025, 6, 30, 21, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:56:22,528] WARNING in apscheduler: Add task #72 (task_72) successfully, next run at 2025-06-30 20:00:00+00:00. [2025-06-30 10:56:22,530] WARNING in apscheduler: Added job_instance: { "id": "72", "kwargs": { "task_id": 72 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_72", "next_run_time": "datetime.datetime(2025, 6, 30, 20, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:56:55,374] WARNING in apscheduler: Update task #72 (ayvens.be) successfully, next run at 2025-06-30 20:00:00+00:00. [2025-06-30 10:56:55,374] WARNING in apscheduler: Updated job_instance: { "id": "72", "kwargs": { "task_id": 72 }, "max_instances": 1, "misfire_grace_time": 600, "name": "ayvens.be", "next_run_time": "datetime.datetime(2025, 6, 30, 20, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:58:13,260] WARNING in apscheduler: Add task #73 (ayvens.fr) successfully, next run at 2025-06-30 20:00:00+00:00. [2025-06-30 10:58:13,261] WARNING in apscheduler: Added job_instance: { "id": "73", "kwargs": { "task_id": 73 }, "max_instances": 1, "misfire_grace_time": 600, "name": "ayvens.fr", "next_run_time": "datetime.datetime(2025, 6, 30, 20, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:58:44,681] WARNING in apscheduler: EVENT_JOB_REMOVED: {'alias': None, 'code': 1024, 'job_id': '71', 'jobstore': 'default'} [2025-06-30 10:58:54,164] WARNING in apscheduler: Update task #71 (bca_logged_out.be) successfully, next run at 2025-06-30 21:00:00+00:00. [2025-06-30 10:58:54,164] WARNING in apscheduler: Updated job_instance: { "id": "71", "kwargs": { "task_id": 71 }, "max_instances": 1, "misfire_grace_time": 600, "name": "bca_logged_out.be", "next_run_time": "datetime.datetime(2025, 6, 30, 21, 0, tzinfo=)", "trigger": "" } [2025-06-30 10:59:11,675] WARNING in apscheduler: EVENT_JOB_REMOVED: {'alias': None, 'code': 1024, 'job_id': '71', 'jobstore': 'default'} [2025-06-30 10:59:21,120] WARNING in apscheduler: Update task #71 (bca_logged_out.be) successfully, next run at 2025-06-30 21:00:00+00:00. [2025-06-30 10:59:21,120] WARNING in apscheduler: Updated job_instance: { "id": "71", "kwargs": { "task_id": 71 }, "max_instances": 1, "misfire_grace_time": 600, "name": "bca_logged_out.be", "next_run_time": "datetime.datetime(2025, 6, 30, 21, 0, tzinfo=)", "trigger": "" } [2025-06-30 11:01:08,049] WARNING in apscheduler: Update task #31 (auto1.fr) successfully, next run at 2025-06-30 17:00:00+00:00. [2025-06-30 11:01:08,050] WARNING in apscheduler: Updated job_instance: { "id": "31", "kwargs": { "task_id": 31 }, "max_instances": 1, "misfire_grace_time": 600, "name": "auto1.fr", "next_run_time": "datetime.datetime(2025, 6, 30, 17, 0, tzinfo=)", "trigger": "" } [2025-06-30 11:01:45,148] WARNING in apscheduler: Add task #74 (auto1.it) successfully, next run at 2025-06-30 21:00:00+00:00. [2025-06-30 11:01:45,149] WARNING in apscheduler: Added job_instance: { "id": "74", "kwargs": { "task_id": 74 }, "max_instances": 1, "misfire_grace_time": 600, "name": "auto1.it", "next_run_time": "datetime.datetime(2025, 6, 30, 21, 0, tzinfo=)", "trigger": "" } [2025-06-30 11:07:35,698] WARNING in apscheduler: Add task #75 (auto1) successfully, next run at 2025-06-30 20:00:00+00:00. [2025-06-30 11:07:35,698] WARNING in apscheduler: Added job_instance: { "id": "75", "kwargs": { "task_id": 75 }, "max_instances": 1, "misfire_grace_time": 600, "name": "auto1", "next_run_time": "datetime.datetime(2025, 6, 30, 20, 0, tzinfo=)", "trigger": "" } [2025-06-30 11:20:00,070] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-06-30 11:20:03,086] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-07-01 06:00:03,624] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-01 06:00:06,684] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-01 07:00:03,287] WARNING in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-01 07:00:05,156] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-01 07:00:05,875] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-01 07:00:06,434] ERROR in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-01 07:00:08,445] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-01 07:00:09,019] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-01 08:00:03,635] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-01 08:00:06,732] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-01 10:00:04,212] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-01 10:00:04,434] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-01 10:00:07,255] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-01 10:00:07,453] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-01 10:20:00,117] WARNING in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-01 10:20:03,153] ERROR in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-01 11:20:00,429] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-07-01 11:20:03,629] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-07-02 06:00:35,332] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-02 06:00:39,839] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-02 07:00:31,332] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-02 07:00:34,534] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-02 07:00:37,129] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-02 07:00:37,829] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-02 08:00:33,029] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-02 08:00:37,732] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-02 08:20:00,933] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-07-02 08:20:04,228] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-07-02 09:00:11,728] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-02 09:00:16,229] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-02 10:00:43,228] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-02 10:00:47,834] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-03 06:00:34,532] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-03 06:00:38,438] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-03 06:20:00,831] WARNING in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-03 06:20:03,930] ERROR in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-03 07:00:16,931] WARNING in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-03 07:00:28,128] ERROR in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-03 07:00:32,839] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-03 07:00:37,235] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-03 08:00:12,829] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-03 08:00:26,229] ERROR in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-03 08:00:37,336] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-03 08:00:41,531] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-03 09:00:11,832] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-03 09:00:15,429] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-03 10:00:36,330] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-03 10:00:41,331] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-04 06:00:36,231] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-04 06:00:39,929] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-04 07:00:31,329] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-04 07:00:36,230] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-04 08:00:37,231] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-04 08:00:40,832] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-04 08:20:01,040] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-07-04 08:20:04,233] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-07-04 09:00:13,228] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-04 09:00:17,229] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-04 09:20:00,632] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-07-04 09:20:03,832] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-07-04 10:00:10,128] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (34, '2025-07-04 10:00:03.028867', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-04 10:00:20,229] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-04 10:00:37,332] ERROR in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-04 10:00:47,931] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-04 10:00:59,232] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-05 06:00:34,729] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-05 06:00:38,537] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-05 07:00:31,529] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-05 07:00:33,228] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-05 07:00:35,329] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-05 07:00:37,329] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-05 08:00:09,729] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (31, '2025-07-05 08:00:02.331355', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-05 08:00:09,730] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2025-07-05 08:00:02.834952', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-05 08:00:10,430] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (45, '2025-07-05 08:00:03.229883', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-05 08:00:10,528] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (37, '2025-07-05 08:00:03.129092', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-05 08:00:33,830] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-05 08:00:37,328] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-05 09:00:12,929] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-05 09:00:17,029] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-05 10:00:47,729] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-05 10:00:51,729] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-06 06:00:09,333] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (37, '2025-07-06 06:00:02.729854', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-06 06:00:33,531] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-06 06:00:39,033] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-06 07:00:18,030] WARNING in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-06 07:00:31,928] ERROR in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-06 07:00:34,531] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-06 07:00:38,833] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-06 08:00:30,329] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-06 08:00:34,031] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-06 08:00:34,730] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-06 08:00:37,530] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-06 09:00:10,132] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-06 09:00:13,530] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-06 10:00:12,330] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-06 10:00:27,031] ERROR in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-06 10:00:34,832] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-06 10:00:38,528] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-07 06:00:31,340] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-07 06:00:38,335] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-07 07:00:32,929] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-07 07:00:33,929] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-07 07:00:37,428] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-07 07:00:37,842] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-07 08:00:08,829] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (26, '2025-07-07 08:00:02.431885', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-07 08:00:36,629] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-07 08:00:41,332] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-07 09:00:11,932] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-07 09:00:15,531] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-07 10:00:09,733] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (34, '2025-07-07 10:00:02.834034', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-07 10:00:15,429] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-07 10:00:29,230] ERROR in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-07 10:00:35,528] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-07 10:00:40,929] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-07 10:20:00,533] WARNING in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-07 10:20:03,728] ERROR in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-08 06:00:09,232] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (34, '2025-07-08 06:00:02.932679', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-08 06:00:29,529] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-08 06:00:35,434] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-08 07:00:10,729] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (49, '2025-07-08 07:00:04.633475', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-08 07:00:33,037] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-08 07:00:39,030] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-08 08:00:10,528] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2025-07-08 08:00:03.831921', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-08 08:00:36,230] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-08 08:00:43,632] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-08 08:20:00,929] WARNING in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-08 08:20:01,031] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-07-08 08:20:04,131] ERROR in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-08 08:20:05,229] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-07-08 09:00:12,731] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-08 09:00:16,234] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-08 09:20:00,433] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-07-08 09:20:03,630] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-07-08 10:00:09,128] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (31, '2025-07-08 10:00:02.832115', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-08 10:00:09,329] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (32, '2025-07-08 10:00:02.930415', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-08 10:00:38,134] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-08 10:00:41,630] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-09 06:00:33,037] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-09 06:00:38,229] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-09 07:00:34,830] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-09 07:00:38,232] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-09 08:00:38,434] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-09 08:00:43,328] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-09 09:00:11,531] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-09 09:00:16,530] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-09 10:00:37,230] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-09 10:00:40,539] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-09 10:00:41,833] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-09 10:00:43,730] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-10 06:00:31,531] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-10 06:00:37,135] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-10 07:00:31,831] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-10 07:00:34,038] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-10 07:00:36,137] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-10 07:00:38,831] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-10 08:00:36,332] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-10 08:00:40,334] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-10 09:00:12,033] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-10 09:00:16,032] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-10 10:00:43,332] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-10 10:00:43,731] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-10 10:00:48,430] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-10 10:00:48,630] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-11 06:00:33,630] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-11 06:00:38,634] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-11 07:00:10,430] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (53, '2025-07-11 07:00:04.132689', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-11 07:00:10,528] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (47, '2025-07-11 07:00:03.230054', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-11 07:00:31,230] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-11 07:00:35,341] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-11 08:00:34,228] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-11 08:00:40,230] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-11 09:00:12,629] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-11 09:00:16,832] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-11 10:00:34,129] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-11 10:00:41,334] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-12 06:00:29,031] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-12 06:00:34,937] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-12 07:00:31,828] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-12 07:00:35,331] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-12 08:00:31,229] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-12 08:00:33,330] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-12 08:00:35,240] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-12 08:00:38,131] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-12 09:00:10,829] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-12 09:00:11,829] WARNING in apscheduler: Fail to execute task #43 (autobuy.fr) on node 1, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autobuy.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2025-07-12 09:00:14,929] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-12 09:00:15,532] ERROR in apscheduler: Fail to execute task #43 (autobuy.fr) on node 1, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autobuy.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2025-07-12 10:00:09,633] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (32, '2025-07-12 10:00:02.831608', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-12 10:00:31,129] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-12 10:00:35,529] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-13 06:00:09,229] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2025-07-13 06:00:03.030285', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-13 06:00:30,931] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-13 06:00:34,928] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-13 06:20:00,835] WARNING in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-13 06:20:04,035] ERROR in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-13 07:00:17,234] WARNING in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-13 07:00:28,630] ERROR in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-13 07:00:32,033] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-13 07:00:36,230] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-13 08:00:34,731] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-13 08:00:38,335] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-13 09:00:13,529] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-13 09:00:17,633] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-13 10:00:33,456] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-13 10:00:37,731] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-14 06:00:09,501] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (33, '2025-07-14 06:00:03.430460', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-14 07:00:32,928] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-14 07:00:37,241] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-14 08:00:11,230] WARNING in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-14 08:00:14,829] WARNING in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-14 08:00:16,228] WARNING in apscheduler: Fail to execute task #51 (autorola_logged_out.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-14 08:00:17,129] WARNING in apscheduler: Fail to execute task #50 (autorola_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-14 08:00:19,029] WARNING in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-14 08:00:23,741] ERROR in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-14 08:00:28,031] ERROR in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-14 08:00:28,329] ERROR in apscheduler: Fail to execute task #51 (autorola_logged_out.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-14 08:00:33,027] ERROR in apscheduler: Fail to execute task #50 (autorola_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-14 08:00:34,231] ERROR in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-14 08:00:37,335] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-14 08:00:42,229] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-14 09:00:10,329] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-14 09:00:14,931] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-14 10:00:10,028] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (32, '2025-07-14 10:00:03.033491', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-14 10:00:12,230] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (53, '2025-07-14 10:00:05.834576', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-14 10:00:13,332] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (51, '2025-07-14 10:00:06.130122', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-14 10:00:33,733] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-14 10:00:37,730] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-14 11:20:00,430] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-07-14 11:20:03,628] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-07-15 06:00:33,130] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-15 06:00:38,035] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-15 07:00:32,130] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-15 07:00:37,229] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-15 08:00:35,732] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-15 08:00:39,835] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-15 09:00:11,743] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-15 09:00:17,029] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-15 10:00:38,139] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-15 10:00:42,831] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-15 21:00:08,730] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2025-07-15 21:00:01.929463', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-16 06:00:10,028] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2025-07-16 06:00:03.033613', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-16 06:00:35,533] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-16 06:00:39,530] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-16 07:00:37,229] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-16 07:00:40,735] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-16 08:00:12,233] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-16 08:00:25,608] ERROR in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-16 08:00:39,628] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-16 08:00:44,229] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-16 10:00:39,431] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-16 10:00:44,230] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-16 10:20:00,432] WARNING in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-16 10:20:03,729] ERROR in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-17 06:00:35,929] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-17 06:00:40,931] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-17 07:00:33,628] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-17 07:00:40,836] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-17 08:00:09,633] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (32, '2025-07-17 08:00:02.932685', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-17 08:00:38,828] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-17 08:00:42,935] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-17 08:20:00,931] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-07-17 08:20:04,128] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-07-17 09:00:14,228] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-17 09:00:19,029] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-17 10:00:40,830] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-17 10:00:45,832] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-18 06:00:39,629] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-18 06:00:43,134] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-18 07:00:10,332] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (41, '2025-07-18 07:00:02.834381', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-18 07:00:36,962] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-18 07:00:41,429] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-18 08:00:40,629] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-18 08:00:44,541] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-18 09:00:13,629] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-18 09:00:16,929] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-18 10:00:39,733] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-18 10:00:40,528] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-18 10:00:45,029] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-19 06:00:35,914] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-19 06:00:40,813] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-19 07:00:36,113] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-19 07:00:41,937] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-19 08:00:37,614] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-19 08:00:42,213] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-19 09:00:12,412] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-19 09:00:16,213] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-19 10:00:36,418] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-19 10:00:41,317] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-20 06:00:36,715] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-20 06:00:38,315] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-20 06:00:41,426] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-20 06:00:42,724] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-20 07:00:08,613] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (31, '2025-07-20 07:00:02.114232', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-20 07:00:10,411] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (48, '2025-07-20 07:00:03.315988', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-20 07:00:32,223] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-20 07:00:35,940] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-20 08:00:35,315] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-20 08:00:40,513] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-20 09:00:12,915] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-20 09:00:16,712] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-20 10:00:38,216] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-20 10:00:42,812] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-21 06:00:37,515] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-21 06:00:44,022] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-21 06:20:01,113] WARNING in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-21 06:20:04,413] ERROR in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-21 07:00:40,611] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-21 07:00:44,412] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-21 08:00:09,414] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2025-07-21 08:00:03.213612', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-21 08:00:40,514] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-21 08:00:46,717] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-21 08:20:01,212] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-07-21 08:20:04,511] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-07-21 09:00:14,115] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-21 09:00:18,419] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-21 09:20:00,714] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-07-21 09:20:04,011] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-07-21 10:00:45,512] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-21 10:00:50,312] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-22 06:00:35,931] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-22 06:00:41,913] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-22 07:00:35,913] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-22 07:00:42,612] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-22 08:00:40,316] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-22 08:00:44,213] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-22 09:00:12,829] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-22 09:00:16,713] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-22 10:00:38,212] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-22 10:00:43,112] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-22 10:20:00,518] WARNING in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-22 10:20:03,911] ERROR in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-23 06:00:30,513] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-23 06:00:39,314] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-23 07:00:14,511] WARNING in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-23 07:00:16,513] WARNING in apscheduler: Fail to execute task #51 (autorola_logged_out.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-23 07:00:17,812] WARNING in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-23 07:00:31,014] ERROR in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-23 07:00:31,112] ERROR in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-23 07:00:31,415] ERROR in apscheduler: Fail to execute task #51 (autorola_logged_out.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-23 07:00:36,521] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-23 07:00:41,312] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-23 08:00:37,811] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-23 08:00:42,313] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-23 09:00:15,913] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-23 09:00:20,212] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-23 10:00:44,334] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-23 10:00:48,621] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-23 10:20:00,517] WARNING in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-23 10:20:04,014] ERROR in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-23 11:20:00,516] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-07-23 11:20:03,716] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-07-24 06:00:27,914] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-24 06:00:34,614] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-24 06:20:01,114] WARNING in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-24 06:20:04,512] ERROR in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-24 07:00:10,816] WARNING in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-24 07:00:19,414] WARNING in apscheduler: Fail to execute task #58 (ayvens.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-24 07:00:21,817] WARNING in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-24 07:00:26,613] ERROR in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-24 07:00:30,911] ERROR in apscheduler: Fail to execute task #58 (ayvens.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-24 07:00:33,411] WARNING in apscheduler: Fail to execute task #72 (ayvens.be) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-24 07:00:34,013] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-24 07:00:35,720] ERROR in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-24 07:00:37,818] ERROR in apscheduler: Fail to execute task #72 (ayvens.be) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-24 07:00:38,517] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-24 08:00:32,314] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-24 08:00:35,912] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-24 08:00:37,012] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-24 08:00:39,713] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-24 09:00:08,413] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-24 09:00:13,514] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-24 10:00:12,315] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (50, '2025-07-24 10:00:04.514876', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-24 10:00:12,412] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (47, '2025-07-24 10:00:04.014071', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-24 10:00:30,616] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-24 10:00:34,314] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-25 06:00:32,614] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-25 06:00:36,212] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-25 07:00:10,115] WARNING in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-25 07:00:19,215] WARNING in apscheduler: Fail to execute task #51 (autorola_logged_out.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-25 07:00:21,911] ERROR in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-25 07:00:32,712] ERROR in apscheduler: Fail to execute task #51 (autorola_logged_out.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-25 07:00:35,412] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-25 07:00:35,414] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-25 07:00:35,415] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-25 07:00:39,311] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-25 07:00:40,213] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-25 07:00:40,213] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-25 08:00:10,016] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2025-07-25 08:00:03.414561', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-25 08:00:10,114] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (32, '2025-07-25 08:00:03.014276', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-25 08:00:36,012] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-25 08:00:39,815] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-25 09:00:11,924] WARNING in apscheduler: Fail to execute task #43 (autobuy.fr) on node 1, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autobuy.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2025-07-25 09:00:12,611] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-25 09:00:15,414] ERROR in apscheduler: Fail to execute task #43 (autobuy.fr) on node 1, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autobuy.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2025-07-25 09:00:16,116] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-25 10:00:10,213] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2025-07-25 10:00:04.011770', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-25 10:00:35,211] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-25 10:00:39,714] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-26 06:00:08,714] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (26, '2025-07-26 06:00:01.814273', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-26 06:00:27,813] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-26 06:00:32,012] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-26 07:00:26,816] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-26 07:00:30,014] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-26 08:00:29,015] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-26 08:00:32,819] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-26 09:00:09,112] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-26 09:00:12,312] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-26 10:00:31,213] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-26 10:00:34,413] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-27 06:00:27,517] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-27 06:00:32,114] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-27 06:20:00,713] WARNING in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-27 06:20:03,915] ERROR in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-27 07:00:06,713] WARNING in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-27 07:00:09,915] WARNING in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-27 07:00:13,613] WARNING in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-27 07:00:14,412] WARNING in apscheduler: Fail to execute task #47 (autorola_logged_out.pt) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.pt' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-27 07:00:15,815] WARNING in apscheduler: Fail to execute task #51 (autorola_logged_out.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-27 07:00:17,914] ERROR in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-27 07:00:23,511] ERROR in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-27 07:00:24,313] ERROR in apscheduler: Fail to execute task #47 (autorola_logged_out.pt) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.pt' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-27 07:00:24,314] WARNING in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-27 07:00:27,011] ERROR in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-27 07:00:27,314] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-27 07:00:28,333] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-27 07:00:28,913] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-27 07:00:28,915] ERROR in apscheduler: Fail to execute task #51 (autorola_logged_out.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-27 07:00:28,918] WARNING in apscheduler: Fail to execute task #71 (bca_logged_out.be) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-27 07:00:30,412] ERROR in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-27 07:00:33,211] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-27 07:00:33,312] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-27 07:00:33,513] ERROR in apscheduler: Fail to execute task #71 (bca_logged_out.be) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-27 07:00:34,234] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-27 08:00:29,112] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-27 08:00:30,616] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-27 08:00:33,012] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-27 08:00:33,913] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-27 09:00:06,213] WARNING in apscheduler: Fail to execute task #43 (autobuy.fr) on node 1, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autobuy.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2025-07-27 09:00:08,113] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-27 09:00:11,512] ERROR in apscheduler: Fail to execute task #43 (autobuy.fr) on node 1, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autobuy.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2025-07-27 09:00:12,115] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-27 10:00:31,719] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-27 10:00:32,612] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-27 10:00:36,213] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-27 10:00:36,214] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-27 10:20:00,413] WARNING in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-27 10:20:03,519] ERROR in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-28 06:00:10,213] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2025-07-28 06:00:03.412705', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-28 06:00:36,022] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-28 06:00:41,617] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-28 06:20:00,914] WARNING in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-28 06:20:04,213] ERROR in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-28 07:00:42,612] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-28 07:00:46,813] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-28 08:00:11,413] WARNING in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-28 08:00:23,716] WARNING in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-28 08:00:25,215] ERROR in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-28 08:00:37,015] WARNING in apscheduler: Fail to execute task #63 (bca_logged_out.nl) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-28 08:00:42,012] ERROR in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-28 08:00:49,014] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-28 08:00:49,812] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-28 08:00:50,118] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-28 08:00:55,812] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-28 08:00:56,712] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-28 08:00:56,814] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-28 08:20:01,212] WARNING in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-28 08:20:04,513] ERROR in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-28 09:00:15,512] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-28 09:00:22,113] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-28 09:20:00,612] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-07-28 09:20:03,818] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-07-28 10:00:10,711] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (34, '2025-07-28 10:00:03.814431', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-28 10:00:11,216] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (30, '2025-07-28 10:00:04.316244', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-28 10:00:11,617] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (45, '2025-07-28 10:00:05.013423', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-28 10:00:12,320] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (50, '2025-07-28 10:00:04.922305', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-28 10:00:44,915] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-28 10:00:49,612] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-28 21:00:07,990] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (67, '2025-07-28 21:00:02.114633', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-29 06:00:38,913] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-29 06:00:42,912] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-29 07:00:35,912] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-29 07:00:39,817] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-29 08:00:11,712] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (46, '2025-07-29 08:00:04.920675', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-29 08:00:40,116] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-29 08:00:43,512] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-29 09:00:13,615] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-29 09:00:17,513] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-29 10:00:10,517] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2025-07-29 10:00:03.817802', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-29 10:00:10,821] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (32, '2025-07-29 10:00:03.612722', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-29 10:00:10,912] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2025-07-29 10:00:03.623151', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-29 10:00:37,123] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-29 10:00:43,820] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-30 06:00:37,624] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-30 06:00:38,615] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-30 06:00:42,411] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-30 06:00:42,721] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-30 07:00:14,215] WARNING in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-30 07:00:17,513] WARNING in apscheduler: Fail to execute task #51 (autorola_logged_out.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-30 07:00:18,212] WARNING in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-30 07:00:26,618] ERROR in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-30 07:00:32,124] ERROR in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-30 07:00:33,529] ERROR in apscheduler: Fail to execute task #51 (autorola_logged_out.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-30 07:00:35,014] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-30 07:00:40,725] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-30 08:00:12,813] WARNING in apscheduler: Fail to execute task #45 (carwow.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'carwow.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-07-30 08:00:28,519] ERROR in apscheduler: Fail to execute task #45 (carwow.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'carwow.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-07-30 08:00:42,813] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-30 08:00:47,822] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-30 08:20:01,212] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-07-30 08:20:04,317] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-07-30 09:00:10,113] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-30 09:00:12,012] WARNING in apscheduler: Fail to execute task #43 (autobuy.fr) on node 1, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autobuy.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2025-07-30 09:00:17,213] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-30 09:00:17,412] ERROR in apscheduler: Fail to execute task #43 (autobuy.fr) on node 1, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autobuy.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2025-07-30 10:00:09,414] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (32, '2025-07-30 10:00:03.111412', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-30 10:00:40,615] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-30 10:00:44,631] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-31 06:00:31,914] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-31 06:00:36,423] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-31 07:00:09,314] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (39, '2025-07-31 07:00:02.914819', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-31 07:00:35,112] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-31 07:00:37,824] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-31 07:00:40,112] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-31 07:00:41,618] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-31 08:00:40,132] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-31 08:00:46,529] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-31 09:00:14,717] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-31 09:00:19,312] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-31 10:00:09,114] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (34, '2025-07-31 10:00:02.818699', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-07-31 10:00:38,612] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-07-31 10:00:42,625] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-01 06:00:36,216] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-01 06:00:40,915] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-01 07:00:10,712] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (46, '2025-08-01 07:00:03.814539', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-01 07:00:10,713] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (25, '2025-08-01 07:00:03.615515', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-01 07:00:10,812] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (47, '2025-08-01 07:00:03.817952', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-01 07:00:10,913] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (49, '2025-08-01 07:00:04.511949', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-01 07:00:33,412] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-01 07:00:37,514] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-01 08:00:11,611] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (33, '2025-08-01 08:00:04.512003', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-01 08:00:12,013] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2025-08-01 08:00:04.616157', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-01 09:00:12,920] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-01 09:00:16,913] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-01 10:00:10,614] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (33, '2025-08-01 10:00:04.212404', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-01 10:00:15,516] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-08-01 10:00:29,316] ERROR in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-08-02 06:00:08,784] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (34, '2025-08-02 06:00:02.812914', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-02 06:00:34,714] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-02 06:00:39,015] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-02 07:00:33,215] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-02 07:00:37,912] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-02 08:00:08,516] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (33, '2025-08-02 08:00:02.814217', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-02 08:00:08,615] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (32, '2025-08-02 08:00:02.715688', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-02 08:00:38,512] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-02 08:00:42,928] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-02 09:00:12,620] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-02 09:00:16,612] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-02 10:00:39,712] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-02 10:00:44,020] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-03 06:00:33,716] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-03 06:00:40,023] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-03 06:00:40,515] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-03 06:00:43,420] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-03 07:00:15,311] WARNING in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-03 07:00:16,313] WARNING in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-03 07:00:16,912] WARNING in apscheduler: Fail to execute task #47 (autorola_logged_out.pt) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.pt' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-03 07:00:18,912] WARNING in apscheduler: Fail to execute task #51 (autorola_logged_out.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-03 07:00:30,721] ERROR in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-03 07:00:31,012] ERROR in apscheduler: Fail to execute task #51 (autorola_logged_out.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-03 07:00:32,511] ERROR in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-03 07:00:32,714] ERROR in apscheduler: Fail to execute task #47 (autorola_logged_out.pt) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.pt' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-03 07:00:36,312] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-03 07:00:40,615] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-03 08:00:36,821] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-03 08:00:41,914] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-03 09:00:10,832] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-03 09:00:15,312] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-03 10:00:37,129] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-03 10:00:43,230] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-04 06:00:41,724] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-04 06:00:46,118] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-04 06:00:48,329] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-04 06:00:49,912] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-04 06:20:01,512] WARNING in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-04 06:20:04,815] ERROR in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-04 07:00:39,612] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-04 07:00:46,628] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-04 08:00:59,032] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-04 08:01:05,018] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-04 08:20:01,113] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-08-04 08:20:04,412] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-08-04 09:20:00,513] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-08-04 09:20:03,719] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-08-04 10:00:10,513] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (25, '2025-08-04 10:00:03.413570', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-04 10:00:11,012] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (33, '2025-08-04 10:00:04.413669', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-05 06:00:45,817] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-05 06:00:54,918] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-05 07:00:52,712] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-05 07:00:57,418] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-05 08:00:10,987] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (33, '2025-08-05 08:00:04.616141', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-05 08:00:16,317] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-08-05 08:00:32,514] ERROR in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-08-05 09:00:24,117] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-05 09:00:30,411] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-05 10:00:45,414] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-05 10:00:55,212] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-06 06:00:50,213] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-06 06:00:55,313] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-06 06:20:02,213] WARNING in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-06 06:20:06,611] ERROR in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-06 07:00:15,513] WARNING in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-06 07:00:25,670] WARNING in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-06 07:00:31,614] ERROR in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-06 07:00:37,113] ERROR in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-06 07:00:43,516] WARNING in apscheduler: Fail to execute task #72 (ayvens.be) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-06 07:00:43,814] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-06 07:00:51,312] ERROR in apscheduler: Fail to execute task #72 (ayvens.be) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-06 07:00:52,313] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-06 08:00:16,611] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2025-08-06 08:00:10.117087', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-06 08:00:51,815] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-06 08:00:58,618] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-06 08:20:02,112] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-08-06 08:20:07,313] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-08-06 09:00:20,112] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-06 09:00:24,914] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-06 09:20:00,917] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-08-06 09:20:04,912] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-08-06 10:00:14,620] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (25, '2025-08-06 10:00:07.714830', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-06 10:00:44,016] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-06 10:00:49,316] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-07 06:00:09,920] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (32, '2025-08-07 06:00:02.924038', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-07 06:00:10,522] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2025-08-07 06:00:03.427629', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-07 06:00:10,920] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (47, '2025-08-07 06:00:03.922336', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-07 06:00:11,122] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (46, '2025-08-07 06:00:04.122069', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-07 06:00:34,731] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-07 06:00:36,922] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-07 06:00:38,225] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-07 06:00:40,924] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-07 06:20:01,126] WARNING in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-07 06:20:04,226] ERROR in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-07 07:00:32,222] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-07 07:00:36,726] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-07 08:00:10,322] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2025-08-07 08:00:03.227176', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-07 08:00:10,325] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (33, '2025-08-07 08:00:02.522788', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-07 08:20:00,826] WARNING in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-07 08:20:04,024] ERROR in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-07 09:00:10,521] WARNING in apscheduler: Fail to execute task #71 (bca_logged_out.be) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-07 09:00:11,929] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-07 09:00:14,523] ERROR in apscheduler: Fail to execute task #71 (bca_logged_out.be) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-07 09:00:15,121] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-07 10:00:45,425] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-07 10:00:46,223] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-07 10:00:49,131] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-07 10:00:49,826] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-08 06:00:34,724] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-08 06:00:39,630] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-08 06:20:00,923] WARNING in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-08 06:20:04,223] ERROR in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-08 07:00:16,422] WARNING in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-08 07:00:17,625] WARNING in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-08 07:00:19,033] WARNING in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-08 07:00:29,124] ERROR in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-08 07:00:30,722] ERROR in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-08 07:00:33,320] ERROR in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-08 07:00:38,226] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-08 07:00:43,331] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-08 07:00:43,932] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-08 07:00:46,733] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-08 08:00:10,921] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-08 08:00:25,021] ERROR in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-08 08:00:35,047] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-08 08:00:39,744] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-08 09:00:10,924] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-08 09:00:14,620] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-08 09:20:00,420] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-08-08 09:20:04,322] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-08-08 10:00:33,225] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-08 10:00:39,625] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-08 10:00:39,628] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-08 10:00:43,041] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-09 06:00:09,124] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (46, '2025-08-09 06:00:03.022749', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-09 06:00:33,624] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-09 06:00:38,637] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-09 06:20:00,621] WARNING in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-09 06:20:03,921] ERROR in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-09 07:00:33,634] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-09 07:00:37,932] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-09 08:00:08,622] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (32, '2025-08-09 08:00:02.221110', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-09 08:00:35,138] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-09 08:00:36,524] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-09 08:00:38,747] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-09 08:00:40,121] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-09 09:00:09,022] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-09 09:00:12,923] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-09 10:00:08,620] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (33, '2025-08-09 10:00:02.020668', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-09 10:00:09,523] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (51, '2025-08-09 10:00:03.125040', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-09 10:00:36,621] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-09 10:00:40,130] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-09 10:20:00,421] WARNING in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-09 10:20:03,623] ERROR in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-10 06:00:39,622] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-10 06:00:43,020] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-10 06:20:00,825] WARNING in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-10 06:20:04,024] ERROR in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-10 07:00:09,323] WARNING in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-10 07:00:14,823] WARNING in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-10 07:00:17,425] WARNING in apscheduler: Fail to execute task #51 (autorola_logged_out.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-10 07:00:20,220] WARNING in apscheduler: Fail to execute task #47 (autorola_logged_out.pt) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.pt' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-10 07:00:20,621] WARNING in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-10 07:00:20,722] ERROR in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-10 07:00:31,822] ERROR in apscheduler: Fail to execute task #51 (autorola_logged_out.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-10 07:00:32,275] WARNING in apscheduler: Fail to execute task #67 (bca_logged_out.de) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.de' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-10 07:00:32,420] ERROR in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-10 07:00:35,823] ERROR in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-10 07:00:36,023] ERROR in apscheduler: Fail to execute task #47 (autorola_logged_out.pt) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.pt' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-10 07:00:38,525] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-10 07:00:39,229] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-10 07:00:40,125] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-10 07:00:41,628] ERROR in apscheduler: Fail to execute task #67 (bca_logged_out.de) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.de' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-10 07:00:43,823] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-10 07:00:44,125] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-10 07:00:44,329] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-10 08:00:34,322] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-10 08:00:40,521] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-10 08:20:00,722] WARNING in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-10 08:20:04,120] ERROR in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-10 09:00:05,122] WARNING in apscheduler: Fail to execute task #39 (ecarstrade.be) on node 1, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ecarstrade.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2025-08-10 09:00:14,823] ERROR in apscheduler: Fail to execute task #39 (ecarstrade.be) on node 1, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ecarstrade.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2025-08-10 10:00:35,333] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-10 10:00:43,541] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-10 10:20:00,422] WARNING in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-10 10:20:03,625] ERROR in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-11 06:00:37,725] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-11 06:00:42,729] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-11 06:20:01,121] WARNING in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-11 06:20:04,321] ERROR in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-11 07:00:33,034] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-11 07:00:38,546] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-11 08:00:36,623] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-11 08:00:41,335] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-11 08:20:01,220] WARNING in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-11 08:20:04,521] ERROR in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-11 09:00:11,121] WARNING in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-11 09:00:12,021] WARNING in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-11 09:00:12,223] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-11 09:00:15,824] ERROR in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-11 09:00:16,325] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-11 09:00:16,923] ERROR in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-11 10:00:13,522] WARNING in apscheduler: Fail to execute task #45 (carwow.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'carwow.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-08-11 10:00:33,829] ERROR in apscheduler: Fail to execute task #45 (carwow.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'carwow.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-08-11 10:00:34,241] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-11 10:00:41,522] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-12 06:00:34,840] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-12 06:00:39,921] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-12 07:00:37,429] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-12 07:00:40,924] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-12 08:00:12,620] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-12 08:00:28,222] ERROR in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-12 08:00:39,024] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-12 08:00:41,655] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-12 08:00:43,729] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-12 08:00:45,032] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-12 09:00:12,325] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-12 09:00:16,424] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-12 10:00:38,821] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-12 10:00:43,125] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-12 10:20:00,426] WARNING in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-12 10:20:03,624] ERROR in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-12 13:45:50,236] WARNING in apscheduler: EVENT_JOB_REMOVED: {'alias': None, 'code': 1024, 'job_id': '49', 'jobstore': 'default'} [2025-08-12 13:45:50,435] WARNING in apscheduler: EVENT_JOB_REMOVED: {'alias': None, 'code': 1024, 'job_id': '48', 'jobstore': 'default'} [2025-08-12 13:46:14,134] WARNING in apscheduler: EVENT_JOB_REMOVED: {'alias': None, 'code': 1024, 'job_id': '69', 'jobstore': 'default'} [2025-08-12 13:46:16,821] WARNING in apscheduler: EVENT_JOB_REMOVED: {'alias': None, 'code': 1024, 'job_id': '68', 'jobstore': 'default'} [2025-08-12 13:46:22,520] WARNING in apscheduler: EVENT_JOB_REMOVED: {'alias': None, 'code': 1024, 'job_id': '66', 'jobstore': 'default'} [2025-08-12 13:47:32,720] WARNING in apscheduler: EVENT_JOB_REMOVED: {'alias': None, 'code': 1024, 'job_id': '59', 'jobstore': 'default'} [2025-08-12 13:47:39,330] WARNING in apscheduler: EVENT_JOB_REMOVED: {'alias': None, 'code': 1024, 'job_id': '47', 'jobstore': 'default'} [2025-08-12 13:47:42,620] WARNING in apscheduler: EVENT_JOB_REMOVED: {'alias': None, 'code': 1024, 'job_id': '46', 'jobstore': 'default'} [2025-08-12 13:48:10,966] WARNING in apscheduler: Task #46 deleted. [2025-08-12 13:48:14,427] WARNING in apscheduler: Task #47 deleted. [2025-08-12 13:48:28,659] WARNING in apscheduler: Task #48 deleted. [2025-08-12 13:48:45,121] WARNING in apscheduler: Update task #49 (autorola_logged_out.nl) successfully, next run at 2025-08-12 21:00:00+00:00. [2025-08-12 13:48:45,121] WARNING in apscheduler: Updated job_instance: { "id": "49", "kwargs": { "task_id": 49 }, "max_instances": 1, "misfire_grace_time": 600, "name": "autorola_logged_out.nl", "next_run_time": "datetime.datetime(2025, 8, 12, 21, 0, tzinfo=)", "trigger": "" } [2025-08-12 13:49:11,225] WARNING in apscheduler: Task #69 deleted. [2025-08-12 13:49:11,869] WARNING in apscheduler: Task #59 deleted. [2025-08-12 13:49:12,121] WARNING in apscheduler: Task #68 deleted. [2025-08-12 13:49:12,421] WARNING in apscheduler: Task #66 deleted. [2025-08-12 13:50:20,538] WARNING in apscheduler: EVENT_JOB_REMOVED: {'alias': None, 'code': 1024, 'job_id': '56', 'jobstore': 'default'} [2025-08-12 13:50:31,773] WARNING in apscheduler: Task #56 deleted. [2025-08-12 20:00:02,624] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-12 20:00:02'} [2025-08-12 20:00:07,125] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-12 20:00:07'} [2025-08-13 06:00:16,525] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-13 06:00:15'} [2025-08-13 06:00:21,224] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-13 06:00:24,125] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-13 06:00:23'} [2025-08-13 06:00:26,921] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-13 07:00:15,730] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-13 07:00:19,121] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-13 07:00:15'} [2025-08-13 07:00:23,928] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-13 07:00:26,525] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-13 07:00:26'} [2025-08-13 08:00:21,524] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-13 08:00:19'} [2025-08-13 08:00:22,627] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-13 08:00:28,522] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-13 08:00:30,621] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-13 08:00:30'} [2025-08-13 09:00:09,022] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-13 09:00:12,827] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-13 10:00:19,744] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-13 10:00:15'} [2025-08-13 10:00:22,428] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-13 10:00:32,235] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-13 10:00:33,929] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-13 10:00:34,030] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-13 10:00:33'} [2025-08-13 10:00:38,120] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-13 20:00:06,123] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-13 20:00:05'} [2025-08-13 20:00:10,721] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-13 20:00:10'} [2025-08-14 06:00:18,223] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-14 06:00:15'} [2025-08-14 06:00:23,321] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-14 06:00:27,324] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-14 06:00:26'} [2025-08-14 06:00:30,421] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-14 07:00:19,521] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-14 07:00:25,227] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-14 07:00:23'} [2025-08-14 07:00:28,520] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-14 07:00:30,224] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-14 07:00:30'} [2025-08-14 08:00:08,520] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-14 08:00:17,725] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-14 08:00:15'} [2025-08-14 08:00:21,923] ERROR in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-14 08:00:25,922] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-14 08:00:28,922] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-14 08:00:28'} [2025-08-14 08:00:29,722] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-14 08:00:32,223] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-14 08:00:33,433] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-14 09:00:08,624] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-14 09:00:12,322] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-14 10:00:18,725] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-14 10:00:17'} [2025-08-14 10:00:26,523] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-14 10:00:29,963] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-14 10:00:29'} [2025-08-14 10:00:31,131] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-14 20:00:08,523] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-14 20:00:08'} [2025-08-14 20:00:11,732] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-14 20:00:11'} [2025-08-15 06:00:10,724] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2025-08-15 06:00:02.220746', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-15 06:00:16,022] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-15 06:00:14'} [2025-08-15 06:00:22,522] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-15 06:00:25,121] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-15 06:00:24'} [2025-08-15 06:00:26,521] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-15 07:00:15,621] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-15 07:00:14'} [2025-08-15 07:00:24,324] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-15 07:00:23'} [2025-08-15 08:00:15,421] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-15 08:00:14'} [2025-08-15 08:00:26,421] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-15 08:00:27,625] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-15 08:00:26'} [2025-08-15 08:00:29,925] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-15 09:00:08,321] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-15 09:00:11,723] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-15 10:00:08,523] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-15 10:00:11,625] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (37, '2025-08-15 10:00:04.022394', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-15 10:00:22,423] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-15 10:00:18'} [2025-08-15 10:00:25,123] ERROR in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-15 10:00:29,424] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-15 10:00:31,521] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-15 10:00:30'} [2025-08-15 10:00:32,622] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-15 10:00:34,526] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-15 10:00:36,526] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-15 20:00:06,121] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-15 20:00:05'} [2025-08-15 20:00:10,423] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-15 20:00:10'} [2025-08-16 06:00:19,322] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-16 06:00:17'} [2025-08-16 06:00:24,722] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-16 06:00:26,062] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-16 06:00:25'} [2025-08-16 06:00:29,022] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-16 07:00:07,821] WARNING in apscheduler: Fail to execute task #51 (autorola_logged_out.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-16 07:00:08,321] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (30, '2025-08-16 07:00:01.522491', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-16 07:00:15,020] WARNING in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-16 07:00:15,221] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-16 07:00:16,520] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-16 07:00:14'} [2025-08-16 07:00:17,023] ERROR in apscheduler: Fail to execute task #51 (autorola_logged_out.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-16 07:00:24,721] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-16 07:00:25,422] ERROR in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-16 07:00:26,221] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-16 07:00:25'} [2025-08-16 08:00:20,323] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-16 08:00:18'} [2025-08-16 08:00:25,422] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-16 08:00:28,626] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-16 08:00:28'} [2025-08-16 08:00:30,423] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-16 09:00:08,521] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-16 09:00:12,223] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-16 10:00:10,922] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (58, '2025-08-16 10:00:04.628273', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-16 10:00:11,120] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2025-08-16 10:00:03.921628', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-16 10:00:11,124] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (31, '2025-08-16 10:00:03.321290', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-16 10:00:11,523] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (63, '2025-08-16 10:00:05.124353', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-16 10:00:13,224] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-16 10:00:19,824] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-16 10:00:18'} [2025-08-16 10:00:25,020] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-16 10:00:30,728] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-16 10:00:30'} [2025-08-16 10:00:32,421] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-16 20:00:04,524] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-16 20:00:04'} [2025-08-16 20:00:08,624] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-16 20:00:08'} [2025-08-17 06:00:09,823] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2025-08-17 06:00:03.524369', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-17 06:00:15,723] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-17 06:00:15'} [2025-08-17 06:00:21,623] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-17 06:00:24,523] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-17 06:00:24'} [2025-08-17 06:00:27,820] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-17 06:20:00,821] WARNING in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-17 06:20:04,021] ERROR in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-17 07:00:18,723] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-17 07:00:23,441] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-17 07:00:21'} [2025-08-17 07:00:26,720] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-17 07:00:29,523] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-17 07:00:29'} [2025-08-17 08:00:14,721] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-17 08:00:15,124] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-17 08:00:13'} [2025-08-17 08:00:22,821] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-17 08:00:26,223] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-17 08:00:25'} [2025-08-17 08:00:27,221] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-17 08:00:29,723] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-17 08:00:32,134] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-17 09:00:09,921] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-17 09:00:13,621] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-17 10:00:19,620] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-17 10:00:18'} [2025-08-17 10:00:27,438] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-17 10:00:28,249] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-17 10:00:28,324] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-17 10:00:28'} [2025-08-17 10:00:32,822] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-17 10:00:33,820] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-17 20:00:06,630] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-17 20:00:06'} [2025-08-17 20:00:09,824] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-17 20:00:09'} [2025-08-18 06:00:21,621] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-18 06:00:19'} [2025-08-18 06:00:28,627] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-18 06:00:33,628] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-18 06:00:32'} [2025-08-18 06:00:35,025] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-18 07:00:09,425] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (31, '2025-08-18 07:00:02.523454', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-18 07:00:09,520] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (41, '2025-08-18 07:00:03.120855', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-18 07:00:10,122] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (53, '2025-08-18 07:00:03.426257', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-18 07:00:20,423] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-18 07:00:16'} [2025-08-18 07:00:29,520] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-18 07:00:28'} [2025-08-18 08:00:12,529] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-18 08:00:21,020] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-18 08:00:19'} [2025-08-18 08:00:22,124] ERROR in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-18 08:00:25,722] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-18 08:00:35,121] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-18 08:00:35,420] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-18 08:00:35'} [2025-08-18 08:00:35,523] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-18 08:00:40,433] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-18 09:00:10,322] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-18 09:00:14,723] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-18 10:00:19,431] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-18 10:00:17'} [2025-08-18 10:00:30,528] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-18 10:00:31,722] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-18 10:00:32,229] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-18 10:00:32'} [2025-08-18 10:00:34,635] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-18 10:00:36,328] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-18 20:00:06,627] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-18 20:00:06'} [2025-08-18 20:00:10,020] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-18 20:00:09'} [2025-08-19 06:00:16,523] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-19 06:00:15'} [2025-08-19 06:00:26,829] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-19 06:00:30,621] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-19 06:00:29'} [2025-08-19 06:00:31,822] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-19 07:00:19,263] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-19 07:00:19,822] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-19 07:00:18'} [2025-08-19 07:00:30,322] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-19 07:00:31,924] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-19 07:00:31'} [2025-08-19 08:00:17,821] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-19 08:00:16'} [2025-08-19 08:00:27,623] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-19 08:00:28,022] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-19 08:00:26'} [2025-08-19 08:00:34,225] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-19 09:00:11,023] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-19 09:00:15,425] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-19 10:00:21,324] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-19 10:00:19'} [2025-08-19 10:00:26,024] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-19 10:00:27,324] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-19 10:00:28,824] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-19 10:00:28'} [2025-08-19 10:00:32,421] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-19 10:00:32,522] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-19 20:00:04,730] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-19 20:00:04'} [2025-08-19 20:00:08,122] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-19 20:00:08'} [2025-08-20 06:00:10,622] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (54, '2025-08-20 06:00:03.821219', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-20 06:00:24,924] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-20 06:00:20'} [2025-08-20 06:00:25,321] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-20 06:00:31,025] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-20 06:00:31'} [2025-08-20 06:00:31,522] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-20 07:00:18,144] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-20 07:00:17'} [2025-08-20 07:00:29,820] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-20 07:00:29'} [2025-08-20 08:00:12,026] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-20 08:00:16,821] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-20 08:00:15'} [2025-08-20 08:00:24,224] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-20 08:00:25,421] ERROR in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-20 08:00:28,620] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-20 08:00:27'} [2025-08-20 08:00:31,032] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-20 09:00:10,521] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-20 09:00:14,523] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-20 10:00:17,025] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-20 10:00:16'} [2025-08-20 10:00:26,741] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-20 10:00:26'} [2025-08-20 10:00:26,829] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-20 10:00:32,631] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-20 20:00:07,620] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-20 20:00:06'} [2025-08-20 20:00:11,121] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-20 20:00:11'} [2025-08-21 06:00:22,726] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-21 06:00:21'} [2025-08-21 06:00:27,825] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-21 06:00:32,842] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-21 06:00:32'} [2025-08-21 06:00:34,758] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-21 07:00:14,525] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-21 07:00:15,520] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-21 07:00:14'} [2025-08-21 07:00:24,922] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-21 07:00:27,320] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-21 07:00:26'} [2025-08-21 08:00:09,421] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (33, '2025-08-21 08:00:02.525984', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-21 08:00:10,620] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (37, '2025-08-21 08:00:03.621024', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-21 08:00:11,021] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (53, '2025-08-21 08:00:04.726331', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-21 08:00:20,721] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-21 08:00:22,823] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-21 08:00:19'} [2025-08-21 08:00:27,322] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-21 08:00:29,525] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-21 08:00:29'} [2025-08-21 08:00:31,925] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-21 09:00:09,720] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-21 09:00:13,521] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-21 10:00:12,822] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-21 10:00:17,021] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-21 10:00:15'} [2025-08-21 10:00:21,143] ERROR in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-21 10:00:29,624] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-21 10:00:30,123] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-21 10:00:29'} [2025-08-21 10:00:32,022] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-21 10:00:34,722] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-21 10:00:36,321] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-21 20:00:06,925] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-21 20:00:06'} [2025-08-21 20:00:10,423] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-21 20:00:10'} [2025-08-22 06:00:21,724] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-22 06:00:19'} [2025-08-22 06:00:24,820] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-22 06:00:26,924] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-22 06:00:28,621] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-22 06:00:28'} [2025-08-22 06:00:29,631] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-22 06:00:31,225] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-22 07:00:16,022] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-22 07:00:18,020] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-22 07:00:16'} [2025-08-22 07:00:27,220] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-22 07:00:28,921] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-22 07:00:28'} [2025-08-22 08:00:08,925] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (31, '2025-08-22 08:00:02.320880', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-22 08:00:17,422] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-22 08:00:16'} [2025-08-22 08:00:24,820] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-22 08:00:29,349] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-22 08:00:29'} [2025-08-22 08:00:32,222] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-22 10:00:13,333] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-22 10:00:12'} [2025-08-22 10:00:27,524] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-22 10:00:28,720] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-22 10:00:28'} [2025-08-22 10:00:31,222] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-22 20:00:06,824] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-22 20:00:06'} [2025-08-22 20:00:10,420] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-22 20:00:10'} [2025-08-23 06:00:25,322] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-23 06:00:22'} [2025-08-23 06:00:26,834] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-23 06:00:32,820] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-23 06:00:32'} [2025-08-23 06:00:32,824] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-23 07:00:14,924] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-23 07:00:14'} [2025-08-23 07:00:26,823] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-23 07:00:26'} [2025-08-23 08:00:08,721] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (33, '2025-08-23 08:00:01.823878', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-23 08:00:09,223] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (51, '2025-08-23 08:00:03.123869', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-23 08:00:21,521] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-23 08:00:20'} [2025-08-23 08:00:26,627] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-23 08:00:27,327] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-23 08:00:27'} [2025-08-23 08:00:30,628] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-23 09:00:08,720] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-23 09:00:12,321] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-23 10:00:10,224] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (26, '2025-08-23 10:00:02.921061', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-23 10:00:19,624] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-23 10:00:17'} [2025-08-23 10:00:24,330] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-23 10:00:30,625] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-23 10:00:30'} [2025-08-23 10:00:30,922] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-23 20:00:05,822] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-23 20:00:05'} [2025-08-23 20:00:09,221] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-23 20:00:09'} [2025-08-24 06:00:17,722] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-24 06:00:16'} [2025-08-24 06:00:24,630] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-24 06:00:27,324] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-24 06:00:26'} [2025-08-24 06:00:30,123] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-24 07:00:16,826] WARNING in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-24 07:00:17,722] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-24 07:00:20,527] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-24 07:00:18'} [2025-08-24 07:00:26,530] ERROR in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-24 07:00:27,321] WARNING in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-24 07:00:27,521] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-24 07:00:27'} [2025-08-24 07:00:27,822] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-24 07:00:31,135] ERROR in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-24 08:00:19,424] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-24 08:00:17'} [2025-08-24 08:00:23,225] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-24 08:00:29,724] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-24 08:00:29'} [2025-08-24 08:00:30,523] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-24 10:00:19,322] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-24 10:00:18'} [2025-08-24 10:00:27,621] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-24 10:00:31,420] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-24 10:00:31,424] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-24 10:00:31'} [2025-08-24 10:00:33,429] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-24 10:00:35,426] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-24 20:00:06,620] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-24 20:00:06'} [2025-08-24 20:00:09,921] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-24 20:00:09'} [2025-08-25 06:00:10,423] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (50, '2025-08-25 06:00:03.920557', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-25 06:00:18,025] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-25 06:00:15'} [2025-08-25 06:00:31,232] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-25 06:00:30'} [2025-08-25 07:00:15,523] WARNING in apscheduler: Fail to execute task #51 (autorola_logged_out.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-25 07:00:18,720] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-25 07:00:20,922] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-25 07:00:18'} [2025-08-25 07:00:27,434] ERROR in apscheduler: Fail to execute task #51 (autorola_logged_out.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-25 07:00:28,922] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-25 07:00:29,823] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-25 07:00:29'} [2025-08-25 07:00:30,623] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-25 07:00:34,729] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-25 08:00:11,924] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (53, '2025-08-25 08:00:04.633890', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-25 08:00:19,925] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-25 08:00:18'} [2025-08-25 08:00:26,722] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-25 08:00:29,522] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-25 08:00:29'} [2025-08-25 08:00:33,121] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-25 09:00:10,723] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-25 09:00:15,121] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-25 10:00:11,222] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (50, '2025-08-25 10:00:04.021643', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-25 10:00:11,323] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (52, '2025-08-25 10:00:04.122004', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-25 10:00:11,528] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (63, '2025-08-25 10:00:04.920412', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-25 10:00:19,228] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-25 10:00:18'} [2025-08-25 10:00:28,730] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-25 10:00:30,949] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-25 10:00:30'} [2025-08-25 10:00:34,125] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-25 20:00:06,224] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-25 20:00:06'} [2025-08-25 20:00:10,024] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-25 20:00:10'} [2025-08-26 06:00:14,920] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-26 06:00:13'} [2025-08-26 06:00:25,224] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-26 06:00:27,331] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-26 06:00:27'} [2025-08-26 06:00:30,921] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-26 07:00:16,723] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-26 07:00:18,621] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-26 07:00:16'} [2025-08-26 07:00:24,824] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-26 07:00:27,325] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-26 07:00:26'} [2025-08-26 08:00:27,523] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-26 08:00:25'} [2025-08-26 08:00:30,021] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-26 08:00:36,822] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-26 08:00:36,824] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-26 08:00:36'} [2025-08-26 09:00:08,523] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-26 09:00:12,022] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-26 10:00:17,320] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-26 10:00:16'} [2025-08-26 10:00:28,733] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-26 10:00:30,535] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-26 10:00:29'} [2025-08-26 10:00:32,422] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-26 10:00:34,035] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-26 10:00:37,026] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-26 20:00:07,521] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-26 20:00:06'} [2025-08-26 20:00:10,723] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-26 20:00:10'} [2025-08-27 06:00:15,321] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-27 06:00:14'} [2025-08-27 06:00:22,123] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-27 06:00:26,622] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-27 06:00:26'} [2025-08-27 06:00:27,530] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-27 07:00:17,422] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-27 07:00:15'} [2025-08-27 07:00:25,622] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-27 07:00:26,629] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-27 07:00:26'} [2025-08-27 07:00:29,433] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-27 08:00:08,325] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (25, '2025-08-27 08:00:02.023811', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-27 08:00:18,324] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-27 08:00:17'} [2025-08-27 08:00:23,122] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-27 08:00:26,421] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-27 08:00:26'} [2025-08-27 08:00:31,025] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-27 09:00:08,230] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-27 09:00:11,624] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-27 10:00:11,420] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-27 10:00:10'} [2025-08-27 10:00:26,821] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-27 10:00:24'} [2025-08-27 10:00:27,634] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-27 10:00:33,129] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-27 20:00:05,725] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-27 20:00:05'} [2025-08-27 20:00:09,221] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-27 20:00:09'} [2025-08-28 06:00:25,020] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-28 06:00:25,822] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-28 06:00:24'} [2025-08-28 06:00:27,223] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-28 06:00:30,524] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-28 06:00:31,222] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-28 06:00:30'} [2025-08-28 06:00:31,921] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-28 07:00:19,022] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-28 07:00:16'} [2025-08-28 07:00:26,826] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-28 07:00:26'} [2025-08-28 08:00:08,324] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (31, '2025-08-28 08:00:02.121854', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-28 08:00:21,523] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-28 08:00:19'} [2025-08-28 08:00:27,321] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-28 08:00:30,321] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-28 08:00:29'} [2025-08-28 08:00:33,827] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-28 09:00:10,624] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-28 09:00:14,221] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-28 09:20:00,520] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-08-28 09:20:03,721] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-08-28 10:00:18,322] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-28 10:00:16'} [2025-08-28 10:00:30,024] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-28 10:00:30,620] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-28 10:00:30'} [2025-08-28 10:00:35,724] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-28 20:00:05,223] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-28 20:00:05'} [2025-08-28 20:00:09,124] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-28 20:00:09'} [2025-08-29 06:00:08,822] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2025-08-29 06:00:02.121490', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-29 06:00:09,093] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (26, '2025-08-29 06:00:01.923817', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-29 06:00:09,293] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (33, '2025-08-29 06:00:02.420867', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-29 06:00:16,124] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-29 06:00:14'} [2025-08-29 06:00:22,321] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-29 06:00:22'} [2025-08-29 07:00:13,823] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-29 07:00:12'} [2025-08-29 07:00:18,922] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-29 07:00:21,023] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-29 07:00:21,425] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-29 07:00:21'} [2025-08-29 07:00:22,527] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-29 07:00:24,525] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-29 08:00:10,723] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (53, '2025-08-29 08:00:03.529464', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-29 08:00:15,523] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-29 08:00:14'} [2025-08-29 08:00:22,822] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-29 08:00:24,626] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-29 08:00:24'} [2025-08-29 08:00:27,922] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-29 09:00:07,125] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-29 09:00:10,522] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-29 10:00:11,920] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2025-08-29 10:00:04.827326', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-29 10:00:17,843] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-29 10:00:17'} [2025-08-29 10:00:25,332] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-29 10:00:27,723] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-29 10:00:27'} [2025-08-29 10:00:31,222] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-29 20:00:05,824] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-29 20:00:05'} [2025-08-29 20:00:09,126] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-29 20:00:09'} [2025-08-30 06:00:06,222] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-30 06:00:06'} [2025-08-30 06:00:08,321] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (25, '2025-08-30 06:00:01.623437', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-30 06:00:08,322] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (33, '2025-08-30 06:00:01.723329', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-30 06:00:08,421] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2025-08-30 06:00:02.221099', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-30 06:00:09,324] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (53, '2025-08-30 06:00:02.720538', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-30 06:00:21,623] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-30 06:00:20'} [2025-08-30 07:00:19,422] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-30 07:00:16'} [2025-08-30 07:00:27,022] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-30 07:00:27,521] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-30 07:00:27'} [2025-08-30 07:00:30,325] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-30 08:00:09,223] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (37, '2025-08-30 08:00:02.023713', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-30 08:00:09,421] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (26, '2025-08-30 08:00:01.721238', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-30 08:00:09,792] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (53, '2025-08-30 08:00:02.620683', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-30 08:00:10,323] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (34, '2025-08-30 08:00:02.022360', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-30 08:00:14,021] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-30 08:00:11'} [2025-08-30 08:00:17,323] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-30 08:00:22,524] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-30 08:00:22,820] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-30 08:00:22'} [2025-08-30 09:00:07,320] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-30 09:00:10,721] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-30 10:00:20,925] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-30 10:00:18'} [2025-08-30 10:00:22,525] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-30 10:00:28,030] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-30 10:00:28,437] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-30 10:00:28'} [2025-08-30 20:00:02,924] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-30 20:00:02'} [2025-08-30 20:00:06,823] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-30 20:00:06'} [2025-08-31 06:00:11,522] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-31 06:00:10'} [2025-08-31 06:00:22,423] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-31 06:00:23,025] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-31 06:00:22'} [2025-08-31 06:00:23,531] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-31 06:00:26,525] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-31 06:00:27,024] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-31 07:00:11,021] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-31 07:00:10'} [2025-08-31 07:00:11,420] WARNING in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-31 07:00:14,326] WARNING in apscheduler: Fail to execute task #51 (autorola_logged_out.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-31 07:00:22,026] ERROR in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-31 07:00:22,334] WARNING in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-31 07:00:23,623] ERROR in apscheduler: Fail to execute task #51 (autorola_logged_out.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-31 07:00:23,923] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-31 07:00:23'} [2025-08-31 07:00:26,722] ERROR in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-31 08:00:09,825] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (52, '2025-08-31 08:00:02.323473', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-31 08:00:09,893] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (50, '2025-08-31 08:00:02.123203', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-31 08:00:10,123] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (58, '2025-08-31 08:00:03.420592', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-31 08:00:16,123] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-31 08:00:15'} [2025-08-31 08:00:18,620] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-31 08:00:23,220] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-31 08:00:23'} [2025-08-31 08:00:23,932] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-31 10:00:09,024] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (30, '2025-08-31 10:00:02.023554', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-31 10:00:09,824] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (37, '2025-08-31 10:00:02.722049', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-08-31 10:00:17,424] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-31 10:00:14'} [2025-08-31 10:00:22,022] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-31 10:00:25,923] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-31 10:00:25'} [2025-08-31 10:00:26,826] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-08-31 20:00:04,021] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-31 20:00:03'} [2025-08-31 20:00:07,523] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-08-31 20:00:07'} [2025-09-01 06:00:16,821] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-01 06:00:16'} [2025-09-01 06:00:19,924] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-01 06:00:26,622] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-01 06:00:26'} [2025-09-01 06:00:26,721] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-01 06:20:01,120] WARNING in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-01 06:20:04,432] ERROR in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-01 07:00:09,920] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (39, '2025-09-01 07:00:02.521095', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-01 07:00:13,238] WARNING in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-01 07:00:14,325] WARNING in apscheduler: Fail to execute task #63 (bca_logged_out.nl) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-01 07:00:16,622] WARNING in apscheduler: Fail to execute task #51 (autorola_logged_out.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-01 07:00:20,221] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-01 07:00:19'} [2025-09-01 07:00:23,120] ERROR in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-01 07:00:23,325] ERROR in apscheduler: Fail to execute task #63 (bca_logged_out.nl) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-01 07:00:24,023] ERROR in apscheduler: Fail to execute task #51 (autorola_logged_out.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-01 07:00:27,424] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-01 07:00:27'} [2025-09-01 08:00:08,122] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-09-01 08:00:17,021] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-01 08:00:14'} [2025-09-01 08:00:18,123] ERROR in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-09-01 08:00:18,222] WARNING in apscheduler: Fail to execute task #45 (carwow.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'carwow.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-09-01 08:00:23,822] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-01 08:00:26,722] ERROR in apscheduler: Fail to execute task #45 (carwow.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'carwow.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-09-01 08:00:27,321] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-01 08:00:26'} [2025-09-01 08:00:29,629] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-01 10:00:09,221] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (32, '2025-09-01 10:00:02.622974', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-01 10:00:09,523] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2025-09-01 10:00:03.122099', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-01 10:00:14,222] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-01 10:00:12'} [2025-09-01 10:00:22,822] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-01 10:00:25,522] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-01 10:00:24'} [2025-09-01 10:00:27,521] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-01 10:00:27,921] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-01 10:00:31,022] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-01 20:00:04,526] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-01 20:00:04'} [2025-09-01 20:00:08,625] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-01 20:00:08'} [2025-09-02 06:00:10,928] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-02 06:00:10'} [2025-09-02 06:00:24,122] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-02 06:00:24,320] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-02 06:00:24'} [2025-09-02 06:00:27,823] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-02 07:00:11,524] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-02 07:00:09'} [2025-09-02 07:00:15,221] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-02 07:00:23,721] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-02 07:00:23'} [2025-09-02 07:00:24,741] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-02 08:00:09,293] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (50, '2025-09-02 08:00:02.521138', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-02 08:00:09,320] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (52, '2025-09-02 08:00:02.625061', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-02 08:00:09,420] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (33, '2025-09-02 08:00:01.820557', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-02 08:00:13,920] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-02 08:00:11'} [2025-09-02 08:00:22,526] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-02 08:00:22'} [2025-09-02 09:00:08,022] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-02 09:00:11,525] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-02 10:00:09,922] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-02 10:00:10,221] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (34, '2025-09-02 10:00:02.727018', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-02 10:00:10,724] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2025-09-02 10:00:03.422721', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-02 10:00:10,923] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-09-02 10:00:12,023] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (51, '2025-09-02 10:00:03.922264', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-02 10:00:13,924] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-02 10:00:12'} [2025-09-02 10:00:19,620] ERROR in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-02 10:00:22,922] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-02 10:00:22,929] ERROR in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-09-02 10:00:24,921] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-02 10:00:24'} [2025-09-02 10:00:26,922] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-02 20:00:02,225] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-02 20:00:02'} [2025-09-02 20:00:06,521] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-02 20:00:06'} [2025-09-03 06:00:13,822] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-03 06:00:10'} [2025-09-03 06:00:23,523] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-03 06:00:23'} [2025-09-03 06:00:25,221] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-03 06:00:26,837] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-03 06:00:28,823] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-03 06:00:30,227] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-03 07:00:09,820] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (41, '2025-09-03 07:00:02.820702', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-03 07:00:12,322] WARNING in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-03 07:00:14,421] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-03 07:00:15,825] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-03 07:00:15'} [2025-09-03 07:00:22,423] ERROR in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-03 07:00:24,026] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-03 07:00:25,732] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-03 07:00:24'} [2025-09-03 07:00:26,333] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-03 07:00:30,225] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-03 08:00:18,824] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-03 08:00:17'} [2025-09-03 08:00:25,241] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-03 08:00:27,121] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-03 08:00:26'} [2025-09-03 08:00:29,323] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-03 10:00:16,624] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-03 10:00:14'} [2025-09-03 10:00:25,524] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-03 10:00:25,824] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-03 10:00:25'} [2025-09-03 10:00:26,522] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-03 10:00:30,730] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-03 10:00:31,124] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-03 20:00:05,924] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-03 20:00:05'} [2025-09-03 20:00:09,125] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-03 20:00:09'} [2025-09-04 06:00:10,223] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (58, '2025-09-04 06:00:03.523807', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-04 06:00:18,425] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-04 06:00:15'} [2025-09-04 06:00:23,420] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-04 06:00:24,422] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-04 06:00:24'} [2025-09-04 06:00:26,126] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-04 06:00:27,331] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-04 06:00:29,330] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-04 07:00:10,025] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (50, '2025-09-04 07:00:03.525332', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-04 07:00:11,592] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (67, '2025-09-04 07:00:04.723706', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-04 07:00:17,621] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-04 07:00:18,721] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-04 07:00:17'} [2025-09-04 07:00:22,520] WARNING in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-04 07:00:23,042] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-04 07:00:23,623] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-04 07:00:23'} [2025-09-04 07:00:26,229] ERROR in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-04 08:00:05,721] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-04 08:00:14,220] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-04 08:00:13'} [2025-09-04 08:00:15,523] ERROR in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-04 08:00:25,425] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-04 08:00:25'} [2025-09-04 09:20:00,525] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-09-04 09:20:04,321] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-09-04 10:00:17,725] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-04 10:00:15'} [2025-09-04 10:00:24,522] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-04 10:00:28,033] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-04 10:00:27'} [2025-09-04 10:00:29,831] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-04 20:00:05,121] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-04 20:00:04'} [2025-09-04 20:00:08,225] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-04 20:00:08'} [2025-09-05 06:00:09,321] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2025-09-05 06:00:02.525794', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-05 06:00:09,921] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (31, '2025-09-05 06:00:02.121294', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-05 06:00:10,820] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (37, '2025-09-05 06:00:02.520459', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-05 06:00:13,521] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-05 06:00:11'} [2025-09-05 06:00:19,321] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-05 06:00:22,143] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-05 06:00:21'} [2025-09-05 06:00:24,221] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-05 07:00:12,722] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-05 07:00:10'} [2025-09-05 07:00:22,522] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-05 07:00:21'} [2025-09-05 08:00:09,820] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2025-09-05 08:00:03.723415', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-05 08:00:10,522] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (31, '2025-09-05 08:00:03.422794', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-05 08:00:17,423] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-05 08:00:16'} [2025-09-05 08:00:23,522] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-05 08:00:26,728] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-05 08:00:26'} [2025-09-05 08:00:28,522] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-05 08:00:28,530] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-05 08:00:32,225] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-05 10:00:10,026] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (32, '2025-09-05 10:00:03.123923', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-05 10:00:11,323] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2025-09-05 10:00:03.622077', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-05 10:00:18,527] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-05 10:00:17'} [2025-09-05 10:00:21,127] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-05 10:00:28,022] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-05 10:00:27'} [2025-09-05 10:00:28,731] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-05 20:00:04,923] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-05 20:00:04'} [2025-09-05 20:00:09,124] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-05 20:00:09'} [2025-09-06 06:00:09,721] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (33, '2025-09-06 06:00:02.220463', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-06 06:00:09,722] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (25, '2025-09-06 06:00:01.920402', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-06 06:00:10,729] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (51, '2025-09-06 06:00:02.523495', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-06 06:00:18,123] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-06 06:00:16'} [2025-09-06 06:00:25,823] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-06 06:00:25'} [2025-09-06 07:00:18,422] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-06 07:00:17'} [2025-09-06 07:00:25,124] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-06 07:00:25'} [2025-09-06 08:00:15,020] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-06 08:00:12'} [2025-09-06 08:00:23,125] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-06 08:00:26,423] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-06 08:00:25'} [2025-09-06 08:00:29,322] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-06 10:00:07,922] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-06 10:00:09,821] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2025-09-06 10:00:03.020444', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-06 10:00:10,122] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (52, '2025-09-06 10:00:03.322477', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-06 10:00:10,125] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (37, '2025-09-06 10:00:02.423774', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-06 10:00:13,323] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-06 10:00:12'} [2025-09-06 10:00:20,520] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-06 10:00:27,726] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-06 10:00:26'} [2025-09-06 10:00:28,420] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-06 20:00:06,321] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-06 20:00:04'} [2025-09-06 20:00:10,021] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-06 20:00:10'} [2025-09-07 06:00:19,423] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-07 06:00:19'} [2025-09-07 06:00:26,824] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-07 06:00:27,434] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-07 06:00:27'} [2025-09-07 06:00:30,633] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-07 07:00:10,224] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (31, '2025-09-07 07:00:02.025868', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-07 07:00:10,420] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (43, '2025-09-07 07:00:02.922331', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-07 07:00:10,860] WARNING in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-07 07:00:12,521] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-07 07:00:19,723] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-07 07:00:18'} [2025-09-07 07:00:22,522] ERROR in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-07 07:00:22,643] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-07 07:00:23,523] WARNING in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-07 07:00:25,824] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-07 07:00:25'} [2025-09-07 07:00:27,522] ERROR in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-07 08:00:19,226] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-07 08:00:16'} [2025-09-07 08:00:24,129] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-07 08:00:28,024] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-07 08:00:27'} [2025-09-07 08:00:29,030] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-07 10:00:09,222] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (31, '2025-09-07 10:00:02.122375', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-07 10:00:15,124] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-07 10:00:12'} [2025-09-07 10:00:23,127] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-07 10:00:27,222] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-07 10:00:26'} [2025-09-07 10:00:30,235] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-07 10:00:30,930] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-07 10:00:33,530] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-07 20:00:07,123] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-07 20:00:06'} [2025-09-07 20:00:10,622] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-07 20:00:10'} [2025-09-08 06:00:09,693] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2025-09-08 06:00:02.626879', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-08 06:00:11,521] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (63, '2025-09-08 06:00:03.923631', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-08 06:00:20,426] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-08 06:00:22,125] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-08 06:00:18'} [2025-09-08 06:00:29,128] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-08 06:00:29,325] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-08 06:00:29'} [2025-09-08 06:20:01,221] WARNING in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-08 06:20:04,520] ERROR in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-08 07:00:08,423] WARNING in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-08 07:00:14,823] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-08 07:00:15,924] WARNING in apscheduler: Fail to execute task #51 (autorola_logged_out.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-08 07:00:18,621] ERROR in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-08 07:00:19,824] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-08 07:00:18'} [2025-09-08 07:00:25,421] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-08 07:00:25,621] ERROR in apscheduler: Fail to execute task #51 (autorola_logged_out.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-08 07:00:27,751] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-08 07:00:28,423] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-08 07:00:28'} [2025-09-08 07:00:31,727] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-08 08:00:09,924] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (31, '2025-09-08 08:00:02.820691', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-08 08:00:13,921] WARNING in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-08 08:00:14,527] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-08 08:00:14'} [2025-09-08 08:00:16,623] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-09-08 08:00:25,321] ERROR in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-08 08:00:28,033] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-08 08:00:26'} [2025-09-08 08:00:28,130] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-08 08:00:29,020] ERROR in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-09-08 08:00:33,530] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-08 09:00:05,623] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-08 09:00:10,325] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-08 09:20:00,421] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-09-08 09:20:03,621] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-09-08 10:00:20,320] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-08 10:00:19'} [2025-09-08 10:00:27,927] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-08 10:00:30,922] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-08 10:00:30'} [2025-09-08 10:00:33,221] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-08 20:00:06,620] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-08 20:00:05'} [2025-09-08 20:00:09,824] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-08 20:00:09'} [2025-09-09 06:00:09,022] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (34, '2025-09-09 06:00:02.424087', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-09 06:00:17,221] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-09 06:00:16'} [2025-09-09 06:00:17,341] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-09 06:00:23,525] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-09 06:00:26,021] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-09 06:00:25'} [2025-09-09 07:00:11,422] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (58, '2025-09-09 07:00:04.222759', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-09 07:00:12,093] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (63, '2025-09-09 07:00:04.520104', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-09 07:00:12,121] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (67, '2025-09-09 07:00:04.523848', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-09 07:00:15,843] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-09 07:00:18,523] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-09 07:00:17'} [2025-09-09 07:00:22,022] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-09 07:00:23,820] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-09 07:00:23'} [2025-09-09 08:00:15,821] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-09 08:00:14'} [2025-09-09 08:00:25,621] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-09 08:00:26,125] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-09 08:00:26'} [2025-09-09 08:00:29,720] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-09 09:00:09,321] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-09 09:00:13,126] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-09 10:00:08,127] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-09 10:00:19,323] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-09 10:00:18'} [2025-09-09 10:00:29,321] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-09 10:00:30,337] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-09 10:00:29'} [2025-09-09 10:00:31,727] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-09 10:00:34,342] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-09 10:00:37,223] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-09 20:00:05,231] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-09 20:00:05'} [2025-09-09 20:00:08,724] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-09 20:00:08'} [2025-09-10 06:00:10,622] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-10 06:00:09'} [2025-09-10 06:00:23,023] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-10 06:00:21'} [2025-09-10 06:00:23,322] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-10 06:00:25,658] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-10 06:00:27,422] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-10 06:00:29,324] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-10 07:00:06,823] WARNING in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-10 07:00:10,424] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (39, '2025-09-10 07:00:02.723204', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-10 07:00:17,223] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-10 07:00:19,829] WARNING in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-10 07:00:21,123] ERROR in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-10 07:00:23,045] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-10 07:00:21'} [2025-09-10 07:00:27,031] ERROR in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-10 07:00:28,325] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-10 07:00:29,821] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-10 07:00:29'} [2025-09-10 08:00:18,022] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-10 08:00:17'} [2025-09-10 08:00:30,930] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-10 08:00:30'} [2025-09-10 08:00:31,324] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-10 08:00:35,524] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-10 09:00:08,224] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-10 09:00:11,624] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-10 10:00:09,722] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (31, '2025-09-10 10:00:03.322774', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-10 10:00:15,323] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-10 10:00:13'} [2025-09-10 10:00:26,923] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-10 10:00:25'} [2025-09-10 10:00:28,528] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-10 10:00:32,533] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-10 10:00:32,820] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-10 10:00:36,526] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-10 20:00:06,620] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-10 20:00:06'} [2025-09-10 20:00:10,524] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-10 20:00:10'} [2025-09-11 06:00:16,321] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-11 06:00:13'} [2025-09-11 06:00:25,922] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-11 06:00:26,620] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-11 06:00:26'} [2025-09-11 06:00:29,433] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-11 06:20:01,022] WARNING in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-11 06:20:04,227] ERROR in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-11 07:00:09,621] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (39, '2025-09-11 07:00:02.023555', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-11 07:00:10,621] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (62, '2025-09-11 07:00:03.123173', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-11 07:00:10,928] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (58, '2025-09-11 07:00:02.626543', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-11 07:00:17,922] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-11 07:00:14'} [2025-09-11 07:00:19,425] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-11 07:00:25,223] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-11 07:00:25'} [2025-09-11 07:00:26,720] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-11 08:00:21,823] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-11 08:00:21'} [2025-09-11 08:00:28,330] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-11 08:00:32,523] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-11 08:00:31'} [2025-09-11 08:00:33,923] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-11 09:00:09,223] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-11 09:00:12,824] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-11 10:00:16,121] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-11 10:00:14'} [2025-09-11 10:00:25,128] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-11 10:00:28,923] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-11 10:00:28'} [2025-09-11 10:00:32,525] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-11 20:00:05,921] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-11 20:00:05'} [2025-09-11 20:00:09,420] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-11 20:00:09'} [2025-09-12 06:00:18,143] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-12 06:00:17'} [2025-09-12 06:00:23,421] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-12 06:00:26,121] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-12 06:00:27,221] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-12 06:00:26'} [2025-09-12 06:00:27,625] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-12 06:00:29,920] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-12 07:00:09,121] WARNING in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-12 07:00:12,721] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-12 07:00:11'} [2025-09-12 07:00:15,824] WARNING in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-12 07:00:16,821] WARNING in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-12 07:00:16,822] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-12 07:00:19,922] ERROR in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-12 07:00:25,526] WARNING in apscheduler: Fail to execute task #71 (bca_logged_out.be) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-12 07:00:26,223] ERROR in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-12 07:00:26,425] ERROR in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-12 07:00:26,531] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-12 07:00:26,824] WARNING in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-12 07:00:27,124] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-12 07:00:25'} [2025-09-12 07:00:28,831] ERROR in apscheduler: Fail to execute task #71 (bca_logged_out.be) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-12 07:00:30,131] ERROR in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-12 08:00:09,131] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (34, '2025-09-12 08:00:02.327296', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-12 08:00:09,692] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2025-09-12 08:00:02.820581', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-12 08:00:11,025] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-12 08:00:16,226] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-12 08:00:15'} [2025-09-12 08:00:20,223] ERROR in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-12 08:00:20,422] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-12 08:00:25,622] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-12 08:00:25'} [2025-09-12 08:00:27,521] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-12 09:00:08,324] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-12 09:00:11,723] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-12 10:00:10,821] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (52, '2025-09-12 10:00:03.822346', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-12 10:00:17,224] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-12 10:00:13'} [2025-09-12 10:00:24,821] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-12 10:00:28,722] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-12 10:00:27'} [2025-09-12 10:00:29,921] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-12 20:00:06,651] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-12 20:00:05'} [2025-09-12 20:00:10,621] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-12 20:00:10'} [2025-09-13 06:00:16,021] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-13 06:00:13'} [2025-09-13 06:00:19,022] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-13 06:00:26,430] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-13 06:00:27,849] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-13 06:00:27'} [2025-09-13 07:00:15,121] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-13 07:00:13'} [2025-09-13 07:00:15,225] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-13 07:00:24,123] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-13 07:00:25,023] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-13 07:00:24'} [2025-09-13 08:00:17,421] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-13 08:00:15'} [2025-09-13 08:00:22,221] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-13 08:00:26,420] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-13 08:00:28,924] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-13 08:00:28'} [2025-09-13 08:00:29,329] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-13 08:00:31,541] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-13 09:00:08,720] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-13 09:00:12,322] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-13 10:00:10,822] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (37, '2025-09-13 10:00:03.322746', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-13 10:00:17,125] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-13 10:00:15'} [2025-09-13 10:00:26,129] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-13 10:00:28,121] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-13 10:00:26'} [2025-09-13 10:00:28,765] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-13 10:00:30,223] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-13 10:00:32,121] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-13 20:00:04,525] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-13 20:00:03'} [2025-09-13 20:00:08,123] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-13 20:00:08'} [2025-09-14 06:00:17,659] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-14 06:00:16'} [2025-09-14 06:00:23,421] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-14 06:00:26,026] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-14 06:00:25'} [2025-09-14 06:00:27,920] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-14 07:00:10,123] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (36, '2025-09-14 07:00:02.125081', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-14 07:00:10,221] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (52, '2025-09-14 07:00:02.922986', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-14 07:00:12,021] WARNING in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-14 07:00:16,523] WARNING in apscheduler: Fail to execute task #51 (autorola_logged_out.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-14 07:00:17,023] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-14 07:00:17'} [2025-09-14 07:00:22,127] ERROR in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-14 07:00:24,125] WARNING in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-14 07:00:24,826] ERROR in apscheduler: Fail to execute task #51 (autorola_logged_out.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-14 07:00:24,925] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-14 07:00:24'} [2025-09-14 07:00:25,024] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-14 07:00:27,630] ERROR in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-14 07:00:28,521] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-14 08:00:14,328] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-14 08:00:13'} [2025-09-14 08:00:24,521] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-14 08:00:25,726] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-14 08:00:25'} [2025-09-14 08:00:28,525] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-14 09:00:07,222] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-14 09:00:10,823] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-14 10:00:09,423] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (32, '2025-09-14 10:00:02.222132', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-14 10:00:18,726] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-14 10:00:15'} [2025-09-14 10:00:22,526] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-14 10:00:26,636] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-14 10:00:28,123] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-14 10:00:28,220] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-14 10:00:27'} [2025-09-14 10:00:30,321] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-14 20:00:03,927] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-14 20:00:03'} [2025-09-14 20:00:07,123] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-14 20:00:07'} [2025-09-15 06:00:19,120] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-15 06:00:19'} [2025-09-15 06:00:24,622] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-15 06:00:27,322] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-15 06:00:26'} [2025-09-15 06:00:29,525] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-15 06:20:01,124] WARNING in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-15 06:20:04,522] ERROR in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-15 07:00:13,025] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-15 07:00:10'} [2025-09-15 07:00:18,220] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-15 07:00:23,425] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-15 07:00:23'} [2025-09-15 07:00:25,826] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-15 08:00:23,723] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-15 08:00:24,823] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-15 08:00:20'} [2025-09-15 08:00:29,526] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-15 08:00:30,338] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-15 08:00:30'} [2025-09-15 10:00:09,225] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-15 10:00:08'} [2025-09-15 10:00:17,121] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-09-15 10:00:22,723] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-15 10:00:21'} [2025-09-15 10:00:22,731] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-15 10:00:29,822] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-15 10:00:29,923] ERROR in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-09-15 20:00:02,825] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-15 20:00:02'} [2025-09-15 20:00:07,123] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-15 20:00:07'} [2025-09-16 06:00:09,594] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2025-09-16 06:00:03.321662', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-16 06:00:09,824] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (34, '2025-09-16 06:00:02.521784', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-16 06:00:12,822] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-16 06:00:11'} [2025-09-16 06:00:21,520] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-16 06:00:24,223] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-16 06:00:21'} [2025-09-16 06:00:27,126] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-16 07:00:10,520] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (52, '2025-09-16 07:00:02.823704', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-16 07:00:11,723] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-16 07:00:10'} [2025-09-16 07:00:23,320] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-16 07:00:22'} [2025-09-16 08:00:18,023] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-16 08:00:16'} [2025-09-16 08:00:27,123] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-16 08:00:27,620] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-16 08:00:28,525] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-16 08:00:28'} [2025-09-16 08:00:31,542] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-16 08:00:31,724] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-16 10:00:07,821] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-16 10:00:17,223] ERROR in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-16 10:00:22,625] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-16 10:00:18'} [2025-09-16 10:00:25,335] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-16 10:00:30,324] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-16 10:00:29'} [2025-09-16 10:00:30,326] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-16 10:00:30,620] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-16 10:00:34,037] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-16 10:20:00,427] WARNING in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-16 10:20:03,621] ERROR in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-16 20:00:05,522] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-16 20:00:05'} [2025-09-16 20:00:09,023] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-16 20:00:09'} [2025-09-17 06:00:08,822] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-17 06:00:08'} [2025-09-17 06:00:10,894] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (53, '2025-09-17 06:00:03.622210', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-17 06:00:22,125] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-17 06:00:19'} [2025-09-17 06:00:26,522] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-17 06:00:30,525] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-17 06:20:01,021] WARNING in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-17 06:20:04,221] ERROR in apscheduler: Fail to execute task #29 (autorola_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-17 07:00:12,324] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-17 07:00:11'} [2025-09-17 07:00:24,225] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-17 07:00:23'} [2025-09-17 08:00:17,627] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-17 08:00:17'} [2025-09-17 08:00:24,122] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-17 08:00:28,721] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-17 08:00:28'} [2025-09-17 08:00:29,531] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-17 09:00:08,924] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-17 09:00:12,822] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-17 10:00:23,321] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-17 10:00:19'} [2025-09-17 10:00:27,821] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-17 10:00:29,922] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-17 10:00:30,722] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-17 10:00:29'} [2025-09-17 10:00:32,925] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-17 10:00:33,621] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-17 20:00:06,842] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-17 20:00:06'} [2025-09-17 20:00:10,424] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-17 20:00:10'} [2025-09-18 08:08:17,305] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-18 08:08:16'} [2025-09-18 08:08:25,924] WARNING in apscheduler.executors.default: Run time of job "autorola_logged_out.it (trigger: cron[year='*', month='*', day='*', week='*', day_of_week='*', hour='6,8,10,18', minute='20', second='0'], next run at: 2025-09-18 08:20:00 UTC)" was missed by 1:48:25.924354 [2025-09-18 08:08:26,111] WARNING in apscheduler.executors.default: Run time of job "bca.uk (trigger: cron[year='*', month='*', day='*', week='*', day_of_week='*', hour='6,8,9,11', minute='20', second='0'], next run at: 2025-09-18 08:20:00 UTC)" was missed by 1:48:26.111221 [2025-09-18 08:08:26,111] WARNING in apscheduler.executors.default: Run time of job "autorola_logged_out.es (trigger: cron[year='*', month='*', day='*', week='*', day_of_week='*', hour='6,8,10,19', minute='30', second='0'], next run at: 2025-09-18 08:30:00 UTC)" was missed by 1:38:26.111653 [2025-09-18 08:08:26,112] WARNING in apscheduler.executors.default: Run time of job "ecarstrade.de (trigger: cron[year='*', month='*', day='*', week='*', day_of_week='*', hour='6,8,20', minute='30', second='0'], next run at: 2025-09-18 08:30:00 UTC)" was missed by 1:38:26.112635 [2025-09-18 08:08:26,112] WARNING in apscheduler.executors.default: Run time of job "astonbarclay.gb (trigger: cron[year='*', month='*', day='*', week='*', day_of_week='*', hour='7,9,19', minute='0', second='0'], next run at: 2025-09-18 09:00:00 UTC)" was missed by 1:08:26.112877 [2025-09-18 08:08:26,201] WARNING in apscheduler.executors.default: Run time of job "ecarstrade.be (trigger: cron[year='*', month='*', day='*', week='*', day_of_week='*', hour='7,9,15', minute='0', second='0'], next run at: 2025-09-18 09:00:00 UTC)" was missed by 1:08:26.201890 [2025-09-18 08:08:26,902] WARNING in apscheduler.executors.default: Run time of job "ecarstrade.nl (trigger: cron[year='*', month='*', day='*', week='*', day_of_week='*', hour='7,9,17', minute='0', second='0'], next run at: 2025-09-18 09:00:00 UTC)" was missed by 1:08:26.902449 [2025-09-18 08:08:26,902] WARNING in apscheduler.executors.default: Run time of job "autobuy.fr (trigger: cron[year='*', month='*', day='*', week='*', day_of_week='*', hour='7,9,23', minute='0', second='0'], next run at: 2025-09-18 09:00:00 UTC)" was missed by 1:08:26.902748 [2025-09-18 08:08:29,202] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-18 08:08:29'} [2025-09-18 08:08:29,804] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-18 08:08:31,805] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-18 08:08:34,008] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-18 08:08:35,103] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-18 09:00:08,108] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-18 09:00:11,208] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-18 10:00:18,505] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-18 10:00:18,906] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-18 10:00:18'} [2025-09-18 10:00:23,217] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-18 10:00:25,703] ERROR in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-18 10:00:26,308] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-18 10:00:26,602] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-18 10:00:26'} [2025-09-18 10:00:28,609] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-18 10:00:31,609] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-18 20:00:04,103] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-18 20:00:03'} [2025-09-18 20:00:07,303] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-18 20:00:07'} [2025-09-19 06:00:10,607] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2025-09-19 06:00:03.606895', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-19 06:00:13,303] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-19 06:00:11'} [2025-09-19 06:00:18,003] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-19 06:00:23,006] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-19 06:00:22'} [2025-09-19 06:00:25,602] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-19 07:00:19,409] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-19 07:00:20,104] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-19 07:00:20'} [2025-09-19 07:00:24,909] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-19 07:00:26,311] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-19 07:00:26,401] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-19 07:00:26'} [2025-09-19 07:00:28,405] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-19 08:00:18,403] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-19 08:00:16'} [2025-09-19 08:00:24,903] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-19 08:00:25,910] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-19 08:00:27,003] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-19 08:00:26'} [2025-09-19 08:00:29,004] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-19 08:00:29,706] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-19 10:00:16,914] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-19 10:00:16'} [2025-09-19 10:00:25,503] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-19 10:00:26,704] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-19 10:00:26'} [2025-09-19 10:00:29,709] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-19 20:00:04,211] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-19 20:00:04'} [2025-09-19 20:00:07,803] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-19 20:00:07'} [2025-09-20 06:00:10,405] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (52, '2025-09-20 06:00:03.402142', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-20 06:00:10,406] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (34, '2025-09-20 06:00:02.702892', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-20 06:00:19,006] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-20 06:00:17'} [2025-09-20 06:00:19,315] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-20 06:00:21,503] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-20 06:00:24,205] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-20 06:00:24,304] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-20 06:00:24'} [2025-09-20 06:00:25,104] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-20 07:00:10,905] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-20 07:00:09'} [2025-09-20 07:00:12,812] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-20 07:00:20,304] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-20 07:00:21,002] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-20 07:00:20'} [2025-09-20 08:00:09,602] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2025-09-20 08:00:02.705168', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-20 08:00:15,702] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-20 08:00:14'} [2025-09-20 08:00:20,003] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-20 08:00:23,305] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-20 08:00:22'} [2025-09-20 08:00:24,102] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-20 09:00:08,014] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-20 09:00:11,305] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-20 10:00:20,004] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-20 10:00:17'} [2025-09-20 10:00:24,802] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-20 10:00:27,116] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-20 10:00:27'} [2025-09-20 10:00:28,608] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-20 20:00:06,737] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-20 20:00:06'} [2025-09-20 20:00:10,103] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-20 20:00:10'} [2025-09-21 06:00:08,902] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (34, '2025-09-21 06:00:02.103565', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-21 06:00:10,503] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-21 06:00:09'} [2025-09-21 06:00:21,709] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-21 06:00:21'} [2025-09-21 06:00:23,303] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-21 06:00:26,804] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-21 07:00:14,003] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-21 07:00:13'} [2025-09-21 07:00:23,303] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-21 07:00:23'} [2025-09-21 08:00:10,503] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (45, '2025-09-21 08:00:03.402548', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-21 08:00:10,707] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-21 08:00:10'} [2025-09-21 08:00:11,107] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (58, '2025-09-21 08:00:03.608253', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-21 08:00:17,303] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-21 08:00:22,211] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-21 08:00:20'} [2025-09-21 08:00:22,605] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-21 09:00:08,604] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-21 09:00:12,207] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-21 10:00:12,006] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-21 10:00:12'} [2025-09-21 10:00:24,304] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-21 10:00:21'} [2025-09-21 10:00:25,504] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-21 10:00:27,114] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-21 10:00:29,418] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-21 10:00:30,403] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-21 20:00:03,905] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-21 20:00:03'} [2025-09-21 20:00:07,203] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-21 20:00:07'} [2025-09-22 06:00:16,304] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-22 06:00:14'} [2025-09-22 06:00:21,007] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-22 06:00:21,904] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-22 06:00:22,913] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-22 06:00:22'} [2025-09-22 06:00:24,512] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-22 06:00:25,304] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-22 07:00:14,302] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-22 07:00:17,108] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-22 07:00:15'} [2025-09-22 07:00:22,503] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-22 07:00:23,503] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-22 07:00:23'} [2025-09-22 08:00:19,703] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-22 08:00:19'} [2025-09-22 08:00:25,306] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-22 08:00:26,803] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-22 08:00:26'} [2025-09-22 08:00:29,004] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-22 10:00:17,723] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-22 10:00:16'} [2025-09-22 10:00:22,305] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-22 10:00:26,605] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-22 10:00:25'} [2025-09-22 10:00:27,307] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-22 20:00:05,013] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-22 20:00:04'} [2025-09-22 20:00:08,506] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-22 20:00:08'} [2025-09-23 06:00:17,002] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-23 06:00:16'} [2025-09-23 06:00:21,505] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-23 06:00:24,812] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-23 06:00:24'} [2025-09-23 06:00:25,909] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-23 06:00:26,003] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-23 06:00:29,303] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-23 07:00:13,702] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-23 07:00:14,707] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-23 07:00:12'} [2025-09-23 07:00:25,604] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-23 07:00:24'} [2025-09-23 07:00:25,617] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-23 08:00:09,603] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-23 08:00:08'} [2025-09-23 08:00:22,714] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-23 08:00:25,105] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-23 08:00:24'} [2025-09-23 08:00:28,002] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-23 09:00:08,703] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-23 09:00:12,802] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-23 10:00:17,601] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-23 10:00:15'} [2025-09-23 10:00:24,703] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-23 10:00:27,105] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-23 10:00:26'} [2025-09-23 10:00:30,719] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-23 20:00:04,642] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-23 20:00:04'} [2025-09-23 20:00:07,932] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-23 20:00:07'} [2025-09-24 06:00:11,129] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (67, '2025-09-24 06:00:04.035093', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-24 06:00:11,328] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (51, '2025-09-24 06:00:02.731274', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-24 06:00:12,527] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-24 06:00:11'} [2025-09-24 06:00:20,038] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-24 06:00:20,232] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-24 06:00:19'} [2025-09-24 06:00:21,831] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-24 06:00:23,828] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-24 06:00:25,629] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-24 07:00:17,528] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-24 07:00:16'} [2025-09-24 07:00:22,129] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-24 07:00:22'} [2025-09-24 08:00:13,029] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-24 08:00:11'} [2025-09-24 08:00:19,428] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-24 08:00:23,330] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-24 08:00:23'} [2025-09-24 08:00:25,333] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-24 09:00:08,329] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-24 09:00:11,631] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-24 10:00:20,734] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-24 10:00:17'} [2025-09-24 10:00:27,233] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-24 10:00:27,238] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-24 10:00:28,741] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-24 10:00:28'} [2025-09-24 10:00:30,431] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-24 10:00:31,034] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-24 20:00:04,332] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-24 20:00:04'} [2025-09-24 20:00:07,731] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-24 20:00:07'} [2025-09-25 06:00:16,332] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-25 06:00:13'} [2025-09-25 06:00:19,629] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-25 06:00:22,035] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-25 06:00:22'} [2025-09-25 06:00:23,130] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-25 07:00:10,128] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (25, '2025-09-25 07:00:01.631509', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-25 07:00:14,028] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-25 07:00:12'} [2025-09-25 07:00:16,628] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-25 07:00:20,128] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-25 07:00:20'} [2025-09-25 07:00:21,028] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-25 08:00:12,328] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-25 08:00:10'} [2025-09-25 08:00:18,929] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-25 08:00:20,727] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-25 08:00:20'} [2025-09-25 08:00:21,329] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-25 08:00:23,134] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-25 08:00:24,729] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-25 09:00:07,632] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-25 09:00:11,531] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-25 10:00:09,936] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (26, '2025-09-25 10:00:02.433747', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-25 10:00:10,622] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2025-09-25 10:00:03.236743', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-25 10:00:21,833] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-25 10:00:21,838] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-25 10:00:21'} [2025-09-25 10:00:26,740] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-25 10:00:27,835] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-25 10:00:27'} [2025-09-25 15:25:21,432] WARNING in apscheduler: Add task #76 (autorola_from_listing.be) successfully, next run at 2025-09-26 02:00:00+00:00. [2025-09-25 15:25:21,442] WARNING in apscheduler: Added job_instance: { "id": "76", "kwargs": { "task_id": 76 }, "max_instances": 1, "misfire_grace_time": 600, "name": "autorola_from_listing.be", "next_run_time": "datetime.datetime(2025, 9, 26, 2, 0, tzinfo=)", "trigger": "" } [2025-09-25 15:26:32,159] WARNING in apscheduler: Add task #77 ( autorola_from_listing.de) successfully, next run at 2025-09-26 02:00:00+00:00. [2025-09-25 15:26:32,160] WARNING in apscheduler: Added job_instance: { "id": "77", "kwargs": { "task_id": 77 }, "max_instances": 1, "misfire_grace_time": 600, "name": " autorola_from_listing.de", "next_run_time": "datetime.datetime(2025, 9, 26, 2, 0, tzinfo=)", "trigger": "" } [2025-09-25 15:27:16,240] WARNING in apscheduler: Add task #78 (autorola_from_listing.es) successfully, next run at 2025-09-26 02:05:00+00:00. [2025-09-25 15:27:16,240] WARNING in apscheduler: Added job_instance: { "id": "78", "kwargs": { "task_id": 78 }, "max_instances": 1, "misfire_grace_time": 600, "name": "autorola_from_listing.es", "next_run_time": "datetime.datetime(2025, 9, 26, 2, 5, tzinfo=)", "trigger": "" } [2025-09-25 15:27:57,536] WARNING in apscheduler: Add task #79 ( autorola_from_listing.fr) successfully, next run at 2025-09-26 02:03:00+00:00. [2025-09-25 15:27:57,537] WARNING in apscheduler: Added job_instance: { "id": "79", "kwargs": { "task_id": 79 }, "max_instances": 1, "misfire_grace_time": 600, "name": " autorola_from_listing.fr", "next_run_time": "datetime.datetime(2025, 9, 26, 2, 3, tzinfo=)", "trigger": "" } [2025-09-25 15:28:59,934] WARNING in apscheduler: Add task #80 (autorola_from_listing.it) successfully, next run at 2025-09-26 02:07:00+00:00. [2025-09-25 15:28:59,935] WARNING in apscheduler: Added job_instance: { "id": "80", "kwargs": { "task_id": 80 }, "max_instances": 1, "misfire_grace_time": 600, "name": "autorola_from_listing.it", "next_run_time": "datetime.datetime(2025, 9, 26, 2, 7, tzinfo=)", "trigger": "" } [2025-09-25 15:30:02,946] WARNING in apscheduler: Add task #81 (autorola_from_listing.nl) successfully, next run at 2025-09-26 02:10:00+00:00. [2025-09-25 15:30:03,027] WARNING in apscheduler: Added job_instance: { "id": "81", "kwargs": { "task_id": 81 }, "max_instances": 1, "misfire_grace_time": 600, "name": "autorola_from_listing.nl", "next_run_time": "datetime.datetime(2025, 9, 26, 2, 10, tzinfo=)", "trigger": "" } [2025-09-25 20:00:04,030] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-25 20:00:04'} [2025-09-25 20:00:07,233] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-25 20:00:07'} [2025-09-26 06:00:13,527] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-26 06:00:12'} [2025-09-26 06:00:19,829] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-26 06:00:21,633] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-26 06:00:21'} [2025-09-26 06:00:23,333] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-26 07:00:07,828] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-26 07:00:08,330] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (41, '2025-09-26 07:00:01.831862', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-26 07:00:08,931] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (58, '2025-09-26 07:00:02.729705', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-26 07:00:16,828] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-26 07:00:15'} [2025-09-26 07:00:17,728] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-26 07:00:21,136] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-26 07:00:21'} [2025-09-26 08:00:16,530] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-26 08:00:14'} [2025-09-26 08:00:24,331] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-26 08:00:26,231] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-26 08:00:25'} [2025-09-26 08:00:27,939] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-26 09:00:07,435] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-26 09:00:10,638] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-26 10:00:11,437] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (51, '2025-09-26 10:00:04.236433', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-26 10:00:11,438] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (53, '2025-09-26 10:00:05.034731', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-26 10:00:19,237] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-26 10:00:13'} [2025-09-26 10:00:26,834] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-26 10:00:29,733] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-26 10:00:29'} [2025-09-26 10:00:32,439] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-26 20:00:04,636] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-26 20:00:04'} [2025-09-26 20:00:08,136] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-26 20:00:08'} [2025-09-27 06:00:17,635] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-27 06:00:15'} [2025-09-27 06:00:22,343] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-27 06:00:27,443] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-27 06:00:27,446] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-27 06:00:27'} [2025-09-27 07:00:11,637] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-27 07:00:13,357] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-27 07:00:11'} [2025-09-27 07:00:20,736] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-27 07:00:20,940] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-27 07:00:20'} [2025-09-27 07:00:21,934] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-27 07:00:26,536] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-27 08:00:10,236] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (52, '2025-09-27 08:00:03.234542', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-27 08:00:14,537] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-27 08:00:13'} [2025-09-27 08:00:23,234] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-27 08:00:25,449] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-27 08:00:25'} [2025-09-27 08:00:29,238] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-27 09:00:07,934] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-27 09:00:11,537] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-27 10:00:16,034] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-27 10:00:15'} [2025-09-27 10:00:21,637] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-27 10:00:26,235] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-27 10:00:27,435] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-27 10:00:27'} [2025-09-27 10:00:28,337] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-27 10:00:30,740] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-27 20:00:02,338] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-27 20:00:02'} [2025-09-27 20:00:07,136] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-27 20:00:07'} [2025-09-28 06:00:18,834] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-28 06:00:17'} [2025-09-28 06:00:23,734] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-28 06:00:26,343] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-28 06:00:26'} [2025-09-28 06:00:27,853] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-28 07:00:17,442] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-28 07:00:17,835] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-28 07:00:14'} [2025-09-28 07:00:22,941] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-28 07:00:24,333] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-28 07:00:25,540] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-28 07:00:25'} [2025-09-28 07:00:26,833] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-28 08:00:19,134] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-28 08:00:19,555] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-28 08:00:17'} [2025-09-28 08:00:24,035] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-28 08:00:24,536] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-28 08:00:24'} [2025-09-28 09:00:06,734] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-28 09:00:10,733] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-28 10:00:14,934] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-28 10:00:13'} [2025-09-28 10:00:17,636] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-28 10:00:23,045] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-28 10:00:25,936] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-28 10:00:26,139] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-28 10:00:25'} [2025-09-28 10:00:27,835] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-28 20:00:05,339] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-28 20:00:05'} [2025-09-28 20:00:08,636] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-28 20:00:08'} [2025-09-29 06:00:15,636] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-29 06:00:14'} [2025-09-29 06:00:25,135] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-29 06:00:27,235] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-29 06:00:26'} [2025-09-29 06:00:30,036] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-29 07:00:18,135] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-29 07:00:16'} [2025-09-29 07:00:18,234] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-29 07:00:25,340] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-29 07:00:25,843] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-29 07:00:27,641] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-29 07:00:27'} [2025-09-29 07:00:29,546] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-29 08:00:10,476] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (32, '2025-09-29 08:00:03.102369', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-29 08:00:11,074] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (45, '2025-09-29 08:00:03.802735', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-29 08:00:18,904] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-29 08:00:18'} [2025-09-29 08:00:21,602] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-29 08:00:28,012] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-29 08:00:29,303] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-29 08:00:28'} [2025-09-29 09:00:08,933] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-29 09:00:12,138] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-29 10:00:10,334] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (31, '2025-09-29 10:00:02.834628', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-29 10:00:11,134] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (26, '2025-09-29 10:00:02.233517', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-29 10:00:17,535] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-29 10:00:15'} [2025-09-29 10:00:23,042] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-29 10:00:26,638] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-29 10:00:24'} [2025-09-29 10:00:27,347] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-29 10:00:27,634] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-29 10:00:30,651] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-29 11:20:00,434] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-09-29 11:20:03,538] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-09-29 20:00:05,429] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-29 20:00:05'} [2025-09-29 20:00:08,732] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-29 20:00:08'} [2025-09-30 06:00:09,828] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-30 06:00:09'} [2025-09-30 06:00:10,234] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (33, '2025-09-30 06:00:01.830647', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-30 06:00:10,300] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (58, '2025-09-30 06:00:03.228936', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-30 06:00:10,429] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (53, '2025-09-30 06:00:02.732821', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-30 06:00:20,728] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-30 06:00:19'} [2025-09-30 07:00:12,728] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-30 07:00:11'} [2025-09-30 07:00:13,131] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-30 07:00:20,529] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-30 07:00:20,531] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-30 07:00:20'} [2025-09-30 08:00:09,133] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (31, '2025-09-30 08:00:02.129729', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-30 08:00:09,730] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (32, '2025-09-30 08:00:02.129505', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-09-30 08:00:19,829] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-30 08:00:18'} [2025-09-30 08:00:20,630] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-30 08:00:26,030] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-30 08:00:26,532] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-30 08:00:26'} [2025-09-30 09:00:08,128] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-30 09:00:11,333] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-30 10:00:12,630] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-09-30 10:00:20,730] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-30 10:00:17'} [2025-09-30 10:00:23,530] ERROR in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-09-30 10:00:24,132] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-30 10:00:26,933] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-30 10:00:26'} [2025-09-30 10:00:28,233] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-09-30 20:00:03,329] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-30 20:00:03'} [2025-09-30 20:00:06,729] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-09-30 20:00:06'} [2025-10-01 06:00:16,931] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-01 06:00:15'} [2025-10-01 06:00:22,331] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-01 06:00:24,951] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-01 06:00:24'} [2025-10-01 06:00:25,734] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-01 07:00:13,328] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-01 07:00:10'} [2025-10-01 07:00:21,831] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-01 07:00:21'} [2025-10-01 08:00:14,533] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-01 08:00:13'} [2025-10-01 08:00:20,029] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-01 08:00:24,730] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-01 08:00:23'} [2025-10-01 08:00:25,644] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-01 09:00:09,231] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-01 09:00:13,133] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-01 10:00:17,230] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-01 10:00:16'} [2025-10-01 10:00:23,130] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-01 10:00:25,331] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-01 10:00:24'} [2025-10-01 10:00:27,130] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-01 20:00:05,631] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-01 20:00:05'} [2025-10-01 20:00:08,832] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-01 20:00:08'} [2025-10-02 06:00:14,228] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-02 06:00:13'} [2025-10-02 06:00:20,828] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-02 06:00:23,730] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-02 06:00:23'} [2025-10-02 06:00:25,128] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-02 06:00:26,237] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-02 06:00:28,834] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-02 07:00:10,028] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-02 07:00:10,200] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (58, '2025-10-02 07:00:03.030623', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-02 07:00:14,731] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-02 07:00:14'} [2025-10-02 07:00:22,029] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-02 07:00:24,432] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-02 07:00:23'} [2025-10-02 08:00:18,729] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-02 08:00:16'} [2025-10-02 08:00:24,529] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-02 08:00:26,938] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-02 08:00:25'} [2025-10-02 08:00:28,334] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-02 09:00:09,028] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-02 09:00:12,928] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-02 09:20:00,430] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-10-02 09:20:03,630] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-10-02 10:00:20,433] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-02 10:00:16'} [2025-10-02 10:00:25,337] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-02 10:00:29,030] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-02 10:00:28'} [2025-10-02 10:00:30,035] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-02 20:00:03,252] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-02 20:00:03'} [2025-10-02 20:00:06,432] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-02 20:00:06'} [2025-10-03 06:00:18,932] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-03 06:00:16'} [2025-10-03 06:00:20,931] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-03 06:00:23,635] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-03 06:00:23'} [2025-10-03 06:00:24,333] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-03 07:00:14,631] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-03 07:00:17,532] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-03 07:00:15'} [2025-10-03 07:00:22,428] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-03 07:00:23,534] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-03 07:00:23'} [2025-10-03 08:00:09,700] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (52, '2025-10-03 08:00:03.227696', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-03 08:00:17,031] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-03 08:00:15'} [2025-10-03 08:00:20,131] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-03 08:00:22,029] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-03 08:00:22,936] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-03 08:00:22'} [2025-10-03 08:00:23,833] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-03 08:00:25,427] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-03 10:00:09,729] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (32, '2025-10-03 10:00:02.234693', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-03 10:00:09,930] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2025-10-03 10:00:02.934261', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-03 10:00:18,029] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-03 10:00:16'} [2025-10-03 10:00:26,734] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-03 10:00:28,030] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-03 10:00:27'} [2025-10-03 10:00:29,332] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-03 10:00:30,928] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-03 10:00:33,128] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-03 20:00:03,529] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-03 20:00:03'} [2025-10-03 20:00:06,831] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-03 20:00:06'} [2025-10-04 06:00:15,028] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-04 06:00:12'} [2025-10-04 06:00:22,728] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-04 06:00:24,230] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-04 06:00:23'} [2025-10-04 06:00:26,229] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-04 07:00:16,929] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-04 07:00:15'} [2025-10-04 07:00:21,929] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-04 07:00:21'} [2025-10-04 08:00:18,331] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-04 08:00:15'} [2025-10-04 08:00:21,229] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-04 08:00:24,130] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-04 08:00:23'} [2025-10-04 08:00:25,131] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-04 09:00:06,929] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-04 09:00:11,130] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-04 10:00:16,031] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-04 10:00:15'} [2025-10-04 10:00:23,129] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-04 10:00:25,529] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-04 10:00:25'} [2025-10-04 10:00:27,028] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-04 20:00:04,429] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-04 20:00:04'} [2025-10-04 20:00:08,531] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-04 20:00:08'} [2025-10-05 06:00:08,728] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (34, '2025-10-05 06:00:01.634663', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-05 06:00:09,827] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (51, '2025-10-05 06:00:02.732225', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-05 06:00:13,931] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-05 06:00:12'} [2025-10-05 06:00:20,230] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-05 06:00:22,749] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-05 06:00:22'} [2025-10-05 06:00:23,631] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-05 07:00:09,855] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (52, '2025-10-05 07:00:02.030119', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-05 07:00:10,028] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (33, '2025-10-05 07:00:01.529477', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-05 07:00:17,937] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-05 07:00:15'} [2025-10-05 07:00:21,933] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-05 07:00:21'} [2025-10-05 08:00:09,831] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (51, '2025-10-05 08:00:02.333712', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-05 08:00:19,028] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-05 08:00:16'} [2025-10-05 08:00:23,934] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-05 08:00:25,838] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-05 08:00:25'} [2025-10-05 08:00:27,829] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-05 09:00:08,428] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-05 09:00:12,332] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-05 10:00:19,428] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-05 10:00:16'} [2025-10-05 10:00:23,630] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-05 10:00:27,936] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-05 10:00:27'} [2025-10-05 10:00:29,629] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-05 20:00:03,130] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-05 20:00:03'} [2025-10-05 20:00:06,533] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-05 20:00:06'} [2025-10-06 06:00:07,129] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-06 06:00:07'} [2025-10-06 06:00:08,533] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (37, '2025-10-06 06:00:01.730298', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-06 06:00:20,330] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-06 06:00:17'} [2025-10-06 06:00:20,733] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-06 06:00:25,430] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-06 07:00:14,131] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-06 07:00:17,129] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-06 07:00:15'} [2025-10-06 07:00:21,728] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-06 07:00:21,740] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-06 07:00:21'} [2025-10-06 08:00:16,229] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-06 08:00:16'} [2025-10-06 08:00:24,832] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-06 08:00:24'} [2025-10-06 09:00:12,846] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-06 09:00:16,230] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-06 10:00:10,630] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (32, '2025-10-06 10:00:04.331683', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-06 10:00:12,200] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2025-10-06 10:00:04.630127', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-06 10:00:12,929] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (50, '2025-10-06 10:00:05.927950', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-06 10:00:13,132] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (53, '2025-10-06 10:00:05.231282', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-06 10:00:14,129] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-06 10:00:14'} [2025-10-06 10:00:24,128] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-06 10:00:25,533] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-06 10:00:24'} [2025-10-06 10:00:29,828] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-06 20:00:06,429] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-06 20:00:05'} [2025-10-06 20:00:10,033] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-06 20:00:10'} [2025-10-07 06:00:15,829] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-07 06:00:14'} [2025-10-07 06:00:21,230] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-07 06:00:23,332] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-07 06:00:23'} [2025-10-07 06:00:25,851] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-07 07:00:12,630] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-07 07:00:15,462] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-07 07:00:13'} [2025-10-07 07:00:20,228] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-07 07:00:22,332] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-07 07:00:22'} [2025-10-07 08:00:20,230] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-07 08:00:18'} [2025-10-07 08:00:27,333] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-07 08:00:29,133] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-07 08:00:28'} [2025-10-07 08:00:30,836] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-07 09:00:14,828] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-07 09:00:18,038] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-07 10:00:15,228] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (25, '2025-10-07 10:00:08.327802', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-07 10:00:23,128] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-07 10:00:21'} [2025-10-07 10:00:29,831] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-07 10:00:33,429] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-07 10:00:33'} [2025-10-07 10:00:34,129] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-07 10:00:34,832] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-07 10:00:37,628] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-07 20:00:05,830] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-07 20:00:04'} [2025-10-07 20:00:09,232] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-07 20:00:09'} [2025-10-08 06:00:18,828] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-08 06:00:17'} [2025-10-08 06:00:20,131] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-08 06:00:25,532] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-08 06:00:25'} [2025-10-08 06:00:25,728] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-08 07:00:14,634] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-08 07:00:14'} [2025-10-08 07:00:15,528] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-08 07:00:22,830] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-08 07:00:22'} [2025-10-08 07:00:23,331] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-08 08:00:13,932] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (50, '2025-10-08 08:00:06.429309', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-08 08:00:19,431] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-08 08:00:18'} [2025-10-08 08:00:24,836] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-08 08:00:29,828] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-08 08:00:29'} [2025-10-08 08:00:30,629] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-08 09:00:08,628] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-08 09:00:12,731] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-08 10:00:18,229] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-08 10:00:17'} [2025-10-08 10:00:28,931] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-08 10:00:29,431] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-08 10:00:29'} [2025-10-08 10:00:33,633] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-08 20:00:11,930] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-08 20:00:11'} [2025-10-08 20:00:15,331] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-08 20:00:15'} [2025-10-09 06:00:13,429] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-09 06:00:12'} [2025-10-09 06:00:23,530] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-09 06:00:23,741] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-09 06:00:23,832] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-09 06:00:23'} [2025-10-09 06:00:27,230] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-09 06:00:27,341] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-09 07:00:21,134] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-09 07:00:19'} [2025-10-09 07:00:24,446] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-09 07:00:24'} [2025-10-09 08:00:16,229] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-09 08:00:15'} [2025-10-09 08:00:19,931] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-09 08:00:24,728] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-09 08:00:23'} [2025-10-09 08:00:25,537] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-09 10:00:16,727] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-09 10:00:15'} [2025-10-09 10:00:21,030] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-09 10:00:27,033] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-09 10:00:26'} [2025-10-09 10:00:27,729] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-09 20:00:04,430] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-09 20:00:04'} [2025-10-09 20:00:07,728] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-09 20:00:07'} [2025-10-10 06:00:17,231] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-10 06:00:15'} [2025-10-10 06:00:19,828] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-10 06:00:25,027] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-10 06:00:25,330] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-10 06:00:25'} [2025-10-10 07:00:11,932] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-10 07:00:12,630] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-10 07:00:10'} [2025-10-10 07:00:21,341] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-10 07:00:22,133] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-10 07:00:21'} [2025-10-10 08:00:12,232] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (60, '2025-10-10 08:00:04.430427', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-10 08:00:22,430] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-10 08:00:25,931] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-10 09:00:08,630] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-10 09:00:12,133] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-10 09:20:00,332] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-10-10 09:20:03,430] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-10-10 10:00:12,429] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-10 10:00:11'} [2025-10-10 10:00:23,133] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-10 10:00:23,728] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-10 10:00:23'} [2025-10-10 10:00:26,832] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-10 20:00:04,230] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-10 20:00:04'} [2025-10-10 20:00:07,732] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-10 20:00:07'} [2025-10-11 06:00:14,542] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-11 06:00:13'} [2025-10-11 06:00:18,639] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-11 06:00:22,131] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-11 06:00:21'} [2025-10-11 06:00:24,528] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-11 07:00:10,631] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-11 07:00:14,729] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-11 07:00:13'} [2025-10-11 07:00:19,127] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-11 07:00:21,428] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-11 07:00:21'} [2025-10-11 08:00:12,531] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-11 08:00:11'} [2025-10-11 08:00:20,229] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-11 08:00:20,230] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-11 08:00:20'} [2025-10-11 08:00:22,532] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-11 08:00:23,728] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-11 08:00:25,731] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-11 10:00:08,928] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (30, '2025-10-11 10:00:01.929183', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-11 10:00:10,230] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (51, '2025-10-11 10:00:02.930610', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-11 10:00:16,935] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-11 10:00:15'} [2025-10-11 10:00:22,328] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-11 10:00:24,229] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-11 10:00:24'} [2025-10-11 10:00:27,029] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-11 20:00:04,230] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-11 20:00:04'} [2025-10-11 20:00:07,831] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-11 20:00:07'} [2025-10-12 06:00:13,528] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-12 06:00:12'} [2025-10-12 06:00:18,037] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-12 06:00:22,327] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-12 06:00:21'} [2025-10-12 06:00:22,930] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-12 07:00:14,330] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-12 07:00:17,133] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-12 07:00:15'} [2025-10-12 07:00:21,828] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-12 07:00:22,931] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-12 07:00:22'} [2025-10-12 08:00:13,846] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-12 08:00:13'} [2025-10-12 08:00:23,729] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-12 08:00:25,128] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-12 08:00:24'} [2025-10-12 08:00:27,828] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-12 09:00:05,830] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-12 09:00:10,628] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-12 10:00:16,632] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-12 10:00:14'} [2025-10-12 10:00:24,532] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-12 10:00:26,928] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-12 10:00:26'} [2025-10-12 10:00:28,128] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-12 20:00:05,430] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-12 20:00:04'} [2025-10-12 20:00:08,828] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-12 20:00:08'} [2025-10-13 06:00:14,829] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-13 06:00:12'} [2025-10-13 06:00:24,528] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-13 06:00:24,529] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-13 06:00:24'} [2025-10-13 06:00:28,328] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-13 07:00:13,131] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-13 07:00:09'} [2025-10-13 07:00:15,029] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-13 07:00:24,634] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-13 07:00:24,929] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-13 07:00:25,029] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-13 07:00:24'} [2025-10-13 07:00:28,031] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-13 08:00:18,433] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-13 08:00:16'} [2025-10-13 08:00:23,229] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-13 08:00:26,528] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-13 08:00:26'} [2025-10-13 08:00:27,132] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-13 09:00:07,529] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-13 09:00:11,533] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-13 10:00:09,727] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (51, '2025-10-13 10:00:02.933244', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-13 10:00:20,231] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-13 10:00:18'} [2025-10-13 10:00:23,228] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-13 10:00:26,634] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-13 10:00:26'} [2025-10-13 10:00:27,538] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-13 20:00:06,332] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-13 20:00:05'} [2025-10-13 20:00:09,740] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-13 20:00:09'} [2025-10-14 06:00:09,329] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2025-10-14 06:00:02.134003', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-14 06:00:15,755] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-14 06:00:14'} [2025-10-14 06:00:20,428] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-14 06:00:23,430] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-14 06:00:23'} [2025-10-14 06:00:24,628] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-14 07:00:14,132] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-14 07:00:12'} [2025-10-14 07:00:14,747] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-14 07:00:22,927] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-14 07:00:22'} [2025-10-14 07:00:23,027] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-14 07:00:23,439] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-14 07:00:26,430] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-14 08:00:14,930] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-14 08:00:13'} [2025-10-14 08:00:24,329] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-14 08:00:25,540] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-14 08:00:25'} [2025-10-14 08:00:27,728] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-14 10:00:18,328] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-14 10:00:16'} [2025-10-14 10:00:23,532] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-14 10:00:26,341] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-14 10:00:26,828] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-14 10:00:26'} [2025-10-14 10:00:28,429] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-14 10:00:29,933] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-14 20:00:04,531] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-14 20:00:04'} [2025-10-14 20:00:08,528] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-14 20:00:08'} [2025-10-15 06:00:15,928] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-15 06:00:15'} [2025-10-15 06:00:21,634] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-15 06:00:24,140] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-15 06:00:24,333] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-15 06:00:24'} [2025-10-15 06:00:25,727] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-15 06:00:27,734] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-15 07:00:10,732] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-15 07:00:10'} [2025-10-15 07:00:13,828] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-15 07:00:21,728] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-15 07:00:23,330] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-15 07:00:22'} [2025-10-15 08:00:09,528] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (51, '2025-10-15 08:00:02.830813', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-15 08:00:16,828] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-15 08:00:13'} [2025-10-15 08:00:20,729] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-15 08:00:25,034] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-15 08:00:25,127] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-15 08:00:25'} [2025-10-15 09:00:08,028] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-15 09:00:12,230] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-15 10:00:18,230] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-15 10:00:16'} [2025-10-15 10:00:27,233] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-15 10:00:29,832] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-15 10:00:29'} [2025-10-15 10:00:31,335] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-15 20:00:03,831] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-15 20:00:03'} [2025-10-15 20:00:07,133] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-15 20:00:07'} [2025-10-16 06:00:16,628] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-16 06:00:14'} [2025-10-16 06:00:21,028] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-16 06:00:25,327] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-16 06:00:24'} [2025-10-16 06:00:25,832] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-16 07:00:13,829] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-16 07:00:16,028] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-16 07:00:14'} [2025-10-16 07:00:22,528] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-16 07:00:24,328] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-16 07:00:23'} [2025-10-16 08:00:09,230] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (26, '2025-10-16 08:00:02.329187', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-16 08:00:17,529] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-16 08:00:15'} [2025-10-16 08:00:23,832] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-16 08:00:26,028] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-16 08:00:25'} [2025-10-16 08:00:27,932] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-16 09:00:07,929] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-16 09:00:12,432] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-16 10:00:23,529] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-16 10:00:20'} [2025-10-16 10:00:26,628] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-16 10:00:27,830] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-16 10:00:30,132] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-16 10:00:29'} [2025-10-16 10:00:30,530] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-16 10:00:31,529] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-16 20:00:04,634] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-16 20:00:04'} [2025-10-16 20:00:07,932] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-16 20:00:07'} [2025-10-17 06:00:17,229] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-17 06:00:16'} [2025-10-17 06:00:22,328] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-17 06:00:26,630] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-17 06:00:25'} [2025-10-17 06:00:27,234] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-17 07:00:15,230] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-17 07:00:18,531] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-17 07:00:16'} [2025-10-17 07:00:22,130] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-17 07:00:23,030] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-17 07:00:23'} [2025-10-17 08:00:11,630] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-17 08:00:11'} [2025-10-17 08:00:12,729] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-17 08:00:21,727] ERROR in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-17 08:00:21,932] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-17 08:00:22,330] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-17 08:00:21'} [2025-10-17 08:00:26,232] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-17 10:00:19,030] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-17 10:00:16'} [2025-10-17 10:00:21,429] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-17 10:00:26,328] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-17 10:00:25'} [2025-10-17 10:00:26,732] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-17 20:00:04,628] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-17 20:00:03'} [2025-10-17 20:00:08,029] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-17 20:00:08'} [2025-10-18 06:00:15,434] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-18 06:00:13'} [2025-10-18 06:00:20,229] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-18 06:00:23,528] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-18 06:00:23'} [2025-10-18 06:00:24,934] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-18 07:00:16,628] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-18 07:00:15'} [2025-10-18 07:00:22,031] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-18 07:00:22'} [2025-10-18 08:00:15,731] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-18 08:00:14'} [2025-10-18 08:00:20,934] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-18 08:00:24,030] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-18 08:00:24'} [2025-10-18 08:00:25,330] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-18 08:00:25,829] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-18 08:00:28,528] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-18 10:00:13,732] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-18 10:00:13'} [2025-10-18 10:00:22,231] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-18 10:00:22,534] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-18 10:00:22'} [2025-10-18 10:00:26,733] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-18 20:00:05,628] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-18 20:00:05'} [2025-10-18 20:00:09,029] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-18 20:00:09'} [2025-10-19 06:00:09,131] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (51, '2025-10-19 06:00:02.727578', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-19 06:00:19,829] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-19 06:00:19,829] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-19 06:00:16'} [2025-10-19 06:00:23,831] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-19 06:00:25,131] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-19 06:00:25'} [2025-10-19 07:00:12,830] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-19 07:00:12'} [2025-10-19 07:00:15,331] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-19 07:00:20,231] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-19 07:00:19'} [2025-10-19 07:00:21,629] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-19 08:00:14,529] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-19 08:00:13'} [2025-10-19 08:00:18,729] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-19 08:00:25,627] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-19 08:00:25'} [2025-10-19 08:00:25,927] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-19 10:00:15,630] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-19 10:00:14'} [2025-10-19 10:00:23,428] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-19 10:00:25,732] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-19 10:00:24'} [2025-10-19 10:00:27,229] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-19 20:00:03,730] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-19 20:00:03'} [2025-10-19 20:00:06,932] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-19 20:00:06'} [2025-10-20 06:00:14,929] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-20 06:00:13'} [2025-10-20 06:00:22,529] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-20 06:00:24,132] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-20 06:00:24'} [2025-10-20 06:00:26,634] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-20 07:00:12,828] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-20 07:00:12'} [2025-10-20 07:00:15,231] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-20 07:00:21,734] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-20 07:00:21'} [2025-10-20 07:00:22,728] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-20 08:00:14,131] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-20 08:00:12'} [2025-10-20 08:00:24,238] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-20 08:00:25,129] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-20 08:00:24'} [2025-10-20 08:00:27,729] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-20 09:00:05,528] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-20 09:00:09,428] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-20 10:00:09,527] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (30, '2025-10-20 10:00:01.927774', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-20 10:00:23,828] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-20 10:00:24,331] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-20 10:00:23'} [2025-10-20 10:00:27,431] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-20 10:00:28,029] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-20 10:00:28'} [2025-10-20 20:00:06,029] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-20 20:00:05'} [2025-10-20 20:00:09,333] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-20 20:00:09'} [2025-10-21 06:00:16,830] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-21 06:00:14'} [2025-10-21 06:00:20,729] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-21 06:00:22,745] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-21 06:00:22'} [2025-10-21 06:00:25,533] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-21 07:00:14,564] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-21 07:00:16,028] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-21 07:00:14'} [2025-10-21 07:00:22,027] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-21 07:00:22,829] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-21 07:00:22'} [2025-10-21 08:00:12,931] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-21 08:00:11'} [2025-10-21 08:00:20,746] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-21 08:00:23,232] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-21 08:00:22'} [2025-10-21 08:00:25,843] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-21 10:00:16,931] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-21 10:00:15'} [2025-10-21 10:00:24,530] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-21 10:00:26,029] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2025-10-21 10:00:25'} [2025-10-21 10:00:28,640] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-22 06:00:15,629] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-22 06:00:15,829] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-22 06:00:19,129] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-22 06:00:19,732] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-22 08:00:14,723] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-22 08:00:17,903] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-22 09:00:05,007] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-22 09:00:08,902] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-22 10:00:09,901] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (54, '2025-10-22 10:00:03.106191', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-22 10:00:11,007] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2025-10-22 10:00:03.202318', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-22 10:00:11,008] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (45, '2025-10-22 10:00:03.402125', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-22 10:00:11,103] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (73, '2025-10-22 10:00:03.807232', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-22 10:00:11,203] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (61, '2025-10-22 10:00:03.407675', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-22 10:00:13,903] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-22 10:00:17,302] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-23 06:00:12,803] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-23 06:00:17,404] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-23 07:00:11,606] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-23 07:00:12,412] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-23 07:00:15,304] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-23 07:00:16,407] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-23 08:00:18,003] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-23 08:00:22,404] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-23 09:00:05,904] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-23 09:00:09,205] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-24 06:00:10,603] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-24 06:00:16,807] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-24 08:00:12,405] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (73, '2025-10-24 08:00:04.502678', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-24 08:00:16,504] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-24 08:00:20,404] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-24 09:00:04,403] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-24 09:00:07,508] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-24 10:00:10,107] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (30, '2025-10-24 10:00:02.603021', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-24 10:00:10,707] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (34, '2025-10-24 10:00:03.204831', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-24 10:00:11,104] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (62, '2025-10-24 10:00:04.303112', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-24 10:00:16,804] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-24 10:00:20,507] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-25 06:00:10,004] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-25 06:00:15,502] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-25 07:00:07,102] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-25 07:00:09,803] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-25 07:00:11,210] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-25 07:00:13,007] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-25 08:00:09,704] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-25 08:00:14,906] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-25 09:00:03,702] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-25 09:00:06,902] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-25 10:00:13,808] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-25 10:00:17,907] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-26 06:00:11,408] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-26 06:00:15,609] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-26 09:00:03,303] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-26 09:00:06,506] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-26 10:00:09,206] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (45, '2025-10-26 10:00:02.406133', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-26 10:00:09,702] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2025-10-26 10:00:02.903555', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-26 10:00:12,812] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-26 10:00:17,102] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-27 06:00:15,506] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-27 06:00:19,403] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-27 08:00:14,507] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-10-27 08:00:16,523] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-27 08:00:17,703] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-27 08:00:20,206] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-27 08:00:20,904] ERROR in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-10-27 08:00:21,606] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-27 09:00:06,803] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-27 09:00:10,406] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-27 09:20:00,516] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-10-27 09:20:03,809] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-10-27 10:00:17,105] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-27 10:00:20,905] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-28 06:00:13,204] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-28 06:00:16,507] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-28 07:00:11,203] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-28 07:00:12,022] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-28 07:00:14,504] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-28 07:00:15,502] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-28 10:00:15,603] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-28 10:00:16,106] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-28 10:00:20,203] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-28 10:00:20,911] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-29 06:00:18,717] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-29 06:00:23,703] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-29 08:00:09,674] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (32, '2025-10-29 08:00:02.702359', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-29 08:00:19,704] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-29 08:00:23,403] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-29 09:00:05,204] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-29 09:00:08,503] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-29 09:20:00,602] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-10-29 09:20:03,809] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-10-29 10:00:11,380] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2025-10-29 10:00:04.005552', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-29 10:00:12,109] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (45, '2025-10-29 10:00:04.305589', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-29 10:00:19,102] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-29 10:00:25,505] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-30 07:00:09,207] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-30 07:00:12,902] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-30 08:00:12,404] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-30 08:00:15,413] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-30 08:00:16,904] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-30 08:00:19,102] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-30 09:00:04,005] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-30 09:00:07,202] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-30 10:00:09,902] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (30, '2025-10-30 10:00:02.406778', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-30 10:00:10,278] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (58, '2025-10-30 10:00:03.705682', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-30 10:00:10,703] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (45, '2025-10-30 10:00:03.608938', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-10-31 06:00:14,308] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-31 06:00:17,805] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-31 08:00:13,903] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-31 08:00:14,402] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-31 08:00:17,704] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-31 08:00:18,502] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-31 10:00:14,402] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-10-31 10:00:18,502] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-01 07:00:09,606] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-01 08:00:10,504] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-01 09:00:03,804] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-01 09:00:07,102] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-02 07:00:10,404] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-02 07:00:11,003] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-02 07:00:14,802] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-02 09:00:03,616] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-02 09:00:07,103] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-02 10:00:14,302] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-02 10:00:18,107] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-03 07:00:06,603] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-04 06:00:12,603] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-04 06:00:12,606] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-04 06:00:16,703] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-04 06:00:17,102] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-05 07:00:10,905] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-05 07:00:14,405] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-05 09:00:05,003] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-05 09:00:08,304] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-05 10:00:19,902] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-05 10:00:24,505] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-05 14:54:17,333] WARNING in apscheduler.executors.default: Run time of job "create_jobs_snapshot (trigger: interval[0:05:00], next run at: 2025-11-05 14:58:11 UTC)" was missed by 0:01:05.599914 [2025-11-05 14:59:13,840] WARNING in apscheduler.executors.default: Run time of job "create_jobs_snapshot (trigger: interval[0:05:00], next run at: 2025-11-05 15:03:11 UTC)" was missed by 0:01:02.106869 [2025-11-06 06:00:08,934] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (32, '2025-11-06 06:00:01.934548', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-06 06:00:09,006] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (54, '2025-11-06 06:00:02.835314', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-06 06:00:09,334] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2025-11-06 06:00:02.733661', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-06 06:00:09,808] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (74, '2025-11-06 06:00:03.540663', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-06 06:00:10,410] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (75, '2025-11-06 06:00:03.835226', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-06 06:00:12,133] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-06 06:00:15,638] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-06 07:00:10,634] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-06 07:00:14,136] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-06 09:00:04,134] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-06 09:00:07,634] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-06 10:00:10,134] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (30, '2025-11-06 10:00:02.435136', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-06 10:00:10,312] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (61, '2025-11-06 10:00:03.035340', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-06 10:00:12,434] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-06 10:00:13,335] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-06 10:00:18,941] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-06 10:00:19,435] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-07 06:00:13,534] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-07 06:00:17,836] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-07 07:00:12,534] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-07 07:00:13,835] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-07 07:00:16,633] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-07 07:00:17,934] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-07 08:00:13,333] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-07 08:00:18,740] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-07 09:00:06,156] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-07 09:00:09,536] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-07 10:00:10,436] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (58, '2025-11-07 10:00:03.636685', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-07 10:00:10,736] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (72, '2025-11-07 10:00:03.839160', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-07 10:00:15,534] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-07 10:00:16,634] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-07 10:00:19,237] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-07 10:00:20,136] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-08 06:00:09,636] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2025-11-08 06:00:02.838621', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-08 06:00:13,456] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-08 06:00:14,834] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-08 06:00:17,535] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-08 06:00:18,534] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-08 07:00:07,944] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-08 07:00:13,335] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-08 08:00:10,134] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (33, '2025-11-08 08:00:02.233495', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-08 08:00:10,435] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (54, '2025-11-08 08:00:03.235845', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-08 08:00:14,835] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-08 08:00:18,134] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-08 09:00:05,334] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-08 09:00:08,540] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-08 10:00:10,939] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (62, '2025-11-08 10:00:03.236445', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-08 10:00:16,035] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-08 10:00:20,343] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-09 06:00:10,036] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (45, '2025-11-09 06:00:02.536875', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-09 06:00:14,690] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-09 06:00:18,838] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-09 07:00:06,538] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-09 07:00:12,338] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-09 08:00:09,135] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (33, '2025-11-09 08:00:01.739665', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-09 09:00:02,935] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-09 09:00:06,039] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-10 07:00:10,033] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-10 07:00:12,533] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-10 07:00:14,335] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-10 07:00:16,536] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-10 08:00:16,636] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-10 08:00:20,934] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-10 09:00:04,433] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-10 09:00:07,734] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-10 10:00:10,834] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (54, '2025-11-10 10:00:03.340713', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-10 10:00:10,934] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (72, '2025-11-10 10:00:03.837830', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-10 10:00:12,434] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (73, '2025-11-10 10:00:04.736697', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-10 10:00:15,836] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-10 10:00:16,933] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-10 10:00:19,735] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-10 10:00:20,338] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-11 06:00:12,434] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-11 06:00:13,916] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-11 06:00:16,737] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-11 06:00:17,239] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-11 07:00:10,340] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-11 07:00:11,135] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-11 07:00:14,537] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-11 07:00:14,835] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-11 08:00:14,535] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-11 08:00:18,635] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-11 09:00:02,634] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-11 09:00:05,840] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-11 10:00:11,234] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (62, '2025-11-11 10:00:03.538226', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-11 10:00:11,506] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2025-11-11 10:00:03.435760', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-11 10:00:11,534] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (37, '2025-11-11 10:00:03.135321', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-11 10:00:13,840] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-11 10:00:15,433] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-11 10:00:17,934] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-11 10:00:19,635] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-12 07:00:06,938] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-12 07:00:10,935] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-12 07:00:11,338] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-12 07:00:14,733] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-12 08:00:12,338] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-12 08:00:15,938] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-12 10:00:15,139] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-12 10:00:15,235] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-12 10:00:19,033] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-12 10:00:19,336] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-13 06:00:10,830] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-13 06:00:15,229] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-13 08:00:12,532] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-13 08:00:15,728] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-14 06:00:14,430] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-14 06:00:14,528] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-14 06:00:17,632] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-14 06:00:18,133] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-14 07:00:12,029] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-14 07:00:15,230] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-14 08:00:13,746] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-14 08:00:17,633] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-15 07:00:09,229] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-15 07:00:13,430] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-15 08:00:13,628] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-15 08:00:17,829] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-15 09:00:03,828] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-15 09:00:07,128] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-15 10:00:09,330] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (45, '2025-11-15 10:00:02.429612', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-15 10:00:09,429] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (34, '2025-11-15 10:00:01.931346', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-15 10:00:15,128] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-15 10:00:18,528] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-16 07:00:08,031] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-16 07:00:12,931] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-16 08:00:11,631] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-16 08:00:15,428] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-16 09:00:02,829] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-16 09:00:06,230] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-16 10:00:11,528] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-16 10:00:16,929] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-17 06:00:09,127] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (72, '2025-11-17 06:00:02.629746', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-17 06:00:13,829] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-17 06:00:14,230] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-17 06:00:17,629] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-17 06:00:17,733] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-17 07:00:08,128] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (70, '2025-11-17 07:00:01.829880', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-17 08:00:09,029] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-17 08:00:09,829] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (74, '2025-11-17 08:00:02.730988', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-17 08:00:15,538] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-17 10:00:15,228] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-17 10:00:18,129] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-17 10:00:20,133] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-17 10:00:21,731] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-18 09:00:04,529] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-18 09:00:07,935] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-18 10:00:12,229] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (72, '2025-11-18 10:00:05.029067', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-18 10:00:12,732] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (75, '2025-11-18 10:00:05.129813', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-18 10:00:12,733] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (74, '2025-11-18 10:00:04.730056', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-18 10:00:16,631] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-11-18 10:00:18,127] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-18 10:00:22,430] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-19 06:00:09,828] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (62, '2025-11-19 06:00:03.028005', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-19 06:00:09,904] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (34, '2025-11-19 06:00:02.131006', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-19 06:00:10,628] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (75, '2025-11-19 06:00:04.128074', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-19 06:00:13,730] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-19 06:00:17,231] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-19 08:00:14,731] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-19 08:00:15,228] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-19 08:00:18,129] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-19 08:00:18,828] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-19 09:00:04,129] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-19 09:00:07,332] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-19 10:00:10,900] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (54, '2025-11-19 10:00:03.531071', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-19 10:00:17,529] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-19 10:00:21,630] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-20 06:00:16,036] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-20 06:00:20,352] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-20 07:00:09,526] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-20 07:00:10,825] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-20 07:00:13,129] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-20 07:00:14,441] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-20 08:00:15,427] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-20 08:00:15,626] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-20 08:00:18,930] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-20 08:00:19,531] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-20 09:00:03,928] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-20 09:00:07,126] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-20 10:00:13,127] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-11-20 10:00:17,125] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-20 10:00:18,827] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-20 10:00:19,828] ERROR in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-11-20 10:00:22,227] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-20 10:00:22,840] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-21 06:00:09,304] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (62, '2025-11-21 06:00:02.527974', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-21 06:00:09,326] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (45, '2025-11-21 06:00:02.126315', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-21 06:00:09,699] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (70, '2025-11-21 06:00:02.626360', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-21 06:00:11,128] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-21 06:00:14,926] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-21 07:00:09,026] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-21 07:00:13,427] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-21 08:00:12,826] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-21 08:00:13,627] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-21 08:00:17,437] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-21 08:00:17,726] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-21 10:00:16,027] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-21 10:00:22,128] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-22 06:00:08,529] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (33, '2025-11-22 06:00:01.826034', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-22 06:00:15,629] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-22 06:00:19,028] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-22 07:00:04,829] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-22 07:00:11,537] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-22 08:00:07,038] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-22 08:00:15,531] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-22 09:00:03,725] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-22 09:00:07,125] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-22 10:00:10,726] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-22 10:00:17,530] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-23 06:00:10,429] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-23 06:00:13,331] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-23 06:00:15,830] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-23 06:00:16,726] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-23 07:00:09,859] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-23 07:00:13,629] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-23 08:00:08,731] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (54, '2025-11-23 08:00:02.630718', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-23 08:00:09,230] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (25, '2025-11-23 08:00:02.130417', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-23 08:00:11,728] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-23 08:00:16,530] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-23 09:00:03,327] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-23 09:00:06,528] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-23 10:00:13,727] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-23 10:00:17,826] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-24 06:00:10,285] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (34, '2025-11-24 06:00:03.180328', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-24 06:00:16,682] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-24 06:00:19,995] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-24 07:00:13,279] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-24 07:00:13,579] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-24 07:00:17,078] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-24 07:00:17,483] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-24 08:00:09,084] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (32, '2025-11-24 08:00:02.382717', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-24 08:00:16,181] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-24 08:00:19,583] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-24 09:00:05,078] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-24 09:00:08,782] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-24 10:00:18,379] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-24 10:00:22,480] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-25 06:00:09,279] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (34, '2025-11-25 06:00:02.079902', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-25 06:00:09,380] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2025-11-25 06:00:02.780626', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-25 06:00:09,579] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (54, '2025-11-25 06:00:02.589443', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-25 06:00:13,278] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-25 06:00:14,381] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-25 06:00:16,582] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-25 06:00:18,382] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-25 07:00:09,481] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-25 07:00:14,291] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-25 08:00:10,080] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (37, '2025-11-25 08:00:02.584037', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-25 08:00:14,983] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-25 08:00:17,483] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-25 08:00:19,794] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-25 08:00:21,489] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-26 07:00:11,780] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-26 07:00:13,991] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-26 07:00:15,983] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-26 07:00:17,580] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-26 08:00:14,680] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-26 08:00:14,681] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-11-26 08:00:19,285] ERROR in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-11-26 08:00:19,480] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-27 06:00:11,186] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (62, '2025-11-27 06:00:03.480141', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-27 06:00:11,379] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (34, '2025-11-27 06:00:02.879065', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-27 06:00:15,780] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-27 06:00:19,283] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-27 07:00:12,382] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-27 07:00:13,379] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-27 07:00:15,684] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-27 07:00:17,078] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-27 08:00:09,184] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (34, '2025-11-27 08:00:02.389769', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-27 08:00:09,184] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (32, '2025-11-27 08:00:02.779775', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-27 09:00:04,386] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-27 09:00:07,779] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-27 10:00:10,081] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (37, '2025-11-27 10:00:02.984232', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-27 10:00:10,479] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (45, '2025-11-27 10:00:03.880651', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-27 10:00:10,678] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (54, '2025-11-27 10:00:03.478323', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-27 10:00:16,079] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-27 10:00:19,684] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-28 06:00:08,378] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (25, '2025-11-28 06:00:01.778422', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-28 06:00:09,051] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (58, '2025-11-28 06:00:02.382125', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-28 06:00:09,682] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (70, '2025-11-28 06:00:03.178558', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-28 07:00:08,879] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-28 07:00:14,579] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-29 06:00:08,382] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-29 06:00:09,980] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (45, '2025-11-29 06:00:03.483245', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-29 06:00:10,479] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (75, '2025-11-29 06:00:04.579414', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-29 06:00:10,678] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (62, '2025-11-29 06:00:03.679119', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-29 06:00:10,881] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (58, '2025-11-29 06:00:03.678901', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-29 06:00:10,881] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (54, '2025-11-29 06:00:03.485034', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-29 06:00:14,480] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-29 07:00:11,282] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-29 07:00:11,479] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-29 07:00:14,579] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-29 07:00:15,179] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-29 08:00:13,780] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-29 08:00:14,578] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-29 08:00:19,179] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-29 08:00:19,679] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-29 09:00:04,179] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-29 09:00:07,681] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-29 10:00:11,278] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (70, '2025-11-29 10:00:04.380751', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-30 06:00:08,184] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-30 06:00:14,381] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-30 06:00:15,300] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-30 06:00:17,584] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-30 07:00:09,278] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-30 07:00:13,078] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-30 08:00:10,881] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (72, '2025-11-30 08:00:03.584169', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-30 08:00:13,978] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-30 08:00:17,380] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-30 10:00:10,478] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (72, '2025-11-30 10:00:03.480904', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-11-30 10:00:13,879] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-11-30 10:00:18,378] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-01 08:00:10,478] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (45, '2025-12-01 08:00:02.781729', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-01 08:00:10,479] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2025-12-01 08:00:03.080436', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-01 08:00:10,981] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (32, '2025-12-01 08:00:02.393216', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-01 08:00:13,097] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-01 08:00:17,080] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-01 09:00:04,780] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-01 09:00:07,980] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-01 10:00:10,878] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (73, '2025-12-01 10:00:03.885911', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-01 10:00:11,880] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-01 10:00:15,980] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-01 10:00:19,180] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-01 10:00:20,180] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-02 08:00:15,232] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-02 08:00:19,038] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-02 08:00:21,334] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-02 08:00:22,637] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-02 09:00:04,841] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-02 09:00:08,033] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-02 10:00:20,444] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-02 10:00:21,033] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-02 10:00:24,340] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-02 10:00:24,937] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-03 06:00:09,436] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (33, '2025-12-03 06:00:01.737506', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-03 10:00:09,532] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2025-12-03 10:00:02.636414', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-04 06:00:09,332] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2025-12-04 06:00:02.436086', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-04 06:00:09,534] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (45, '2025-12-04 06:00:02.731599', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-04 06:00:11,133] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (58, '2025-12-04 06:00:04.333289', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-04 08:00:10,133] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (61, '2025-12-04 08:00:03.634013', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-04 08:00:14,534] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-04 08:00:21,131] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-05 06:00:10,183] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (54, '2025-12-05 06:00:02.684557', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-05 06:00:10,378] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (58, '2025-12-05 06:00:02.878155', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-05 06:00:13,881] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-05 06:00:15,379] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-05 06:00:18,181] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-05 06:00:19,381] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-05 08:00:11,351] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (72, '2025-12-05 08:00:04.578430', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-05 08:00:14,085] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-05 08:00:16,980] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-05 08:00:17,683] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-05 08:00:20,280] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-05 09:00:04,780] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-05 09:00:07,983] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-06 07:00:09,381] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-06 07:00:14,783] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-06 08:00:09,550] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (34, '2025-12-06 08:00:02.083431', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-06 08:00:09,980] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (61, '2025-12-06 08:00:03.280108', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-06 08:00:13,580] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-06 08:00:13,880] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-06 08:00:16,978] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-06 08:00:17,578] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-06 09:00:02,983] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-06 09:00:06,579] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-06 10:00:09,351] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2025-12-06 10:00:02.684467', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-06 10:00:09,779] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (37, '2025-12-06 10:00:02.681523', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-06 10:00:13,480] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-06 10:00:18,479] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-07 06:00:09,587] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (61, '2025-12-07 06:00:02.882413', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-07 06:00:09,778] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (70, '2025-12-07 06:00:03.079105', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-07 08:00:14,679] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-07 08:00:17,179] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-07 08:00:20,581] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-07 08:00:20,983] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-08 06:00:11,879] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (62, '2025-12-08 06:00:03.880251', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-08 06:00:12,278] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (58, '2025-12-08 06:00:03.979800', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-08 07:00:16,180] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-08 07:00:19,385] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-08 08:00:19,580] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-08 08:00:24,280] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-08 10:00:09,880] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (33, '2025-12-08 10:00:02.678423', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-08 10:00:09,978] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (34, '2025-12-08 10:00:02.880785', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-08 10:00:11,081] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (54, '2025-12-08 10:00:04.080203', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-09 09:00:04,579] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-09 09:00:08,181] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-09 10:00:09,578] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (54, '2025-12-09 10:00:03.579219', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-09 10:00:14,884] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-09 10:00:21,280] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-10 07:00:12,682] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-10 07:00:16,779] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-10 08:00:09,781] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2025-12-10 08:00:02.582455', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-10 08:00:13,980] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-10 08:00:15,080] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-10 08:00:18,780] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-10 08:00:19,181] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-10 10:00:09,882] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (32, '2025-12-10 10:00:02.379934', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-10 10:00:11,078] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (45, '2025-12-10 10:00:03.478728', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-10 10:00:15,382] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-11 06:00:15,798] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-11 06:00:19,781] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-11 07:00:11,779] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-11 07:00:14,278] WARNING in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-11 07:00:14,880] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-11 07:00:15,779] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-11 07:00:17,978] ERROR in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-11 07:00:18,482] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-11 08:00:09,878] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (37, '2025-12-11 08:00:02.278594', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-11 08:00:14,080] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-11 08:00:16,787] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-11 08:00:19,281] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-11 08:00:20,580] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-11 09:00:04,681] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-11 09:00:08,180] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-11 10:00:09,380] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (37, '2025-12-11 10:00:03.182674', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-11 10:00:10,484] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (33, '2025-12-11 10:00:02.880198', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-12 06:00:10,179] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (73, '2025-12-12 06:00:03.378724', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-12 06:00:10,382] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2025-12-12 06:00:02.785552', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-12 06:00:14,079] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-12 06:00:15,582] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-12 06:00:18,579] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-12 06:00:19,282] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-12 07:00:08,582] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (58, '2025-12-12 07:00:01.980682', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-12 07:00:08,983] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (43, '2025-12-12 07:00:01.680511', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-12 07:00:10,680] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-12 07:00:12,081] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-12 07:00:14,479] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-12 07:00:15,479] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-12 08:00:14,879] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-12 08:00:17,583] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-12 08:00:19,634] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-12 08:00:21,878] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-12 09:00:04,784] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-12 09:00:08,181] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-12 10:00:10,884] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2025-12-12 10:00:03.180812', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-12 10:00:10,953] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (58, '2025-12-12 10:00:03.581017', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-12 10:00:15,782] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-12 10:00:17,293] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-12 10:00:17,301] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-12 10:00:19,881] ERROR in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-12 10:00:21,681] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-12 10:00:21,882] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-13 06:00:14,981] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-13 06:00:16,180] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-13 06:00:18,681] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-13 06:00:20,879] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-13 07:00:09,083] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (58, '2025-12-13 07:00:01.881138', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-13 07:00:09,281] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-13 07:00:15,182] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-13 08:00:13,780] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-13 08:00:15,778] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-13 08:00:17,280] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-13 08:00:19,579] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-13 08:00:20,081] ERROR in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-13 08:00:20,780] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-13 09:00:04,487] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-13 09:00:07,878] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-14 06:00:15,880] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-14 06:00:20,480] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-14 08:00:15,880] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-14 08:00:20,878] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-14 09:00:04,479] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-14 09:00:08,181] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-14 10:00:10,279] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2025-12-14 10:00:02.578831', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-15 06:00:17,381] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-15 06:00:21,182] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-15 07:00:14,082] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-15 07:00:18,182] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-15 08:00:09,951] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (45, '2025-12-15 08:00:03.280429', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-15 08:00:16,285] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-15 08:00:20,284] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-15 09:59:58,691] WARNING in apscheduler: EVENT_JOB_REMOVED: {'alias': None, 'code': 1024, 'job_id': '43', 'jobstore': 'default'} [2025-12-15 10:00:10,952] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2025-12-15 10:00:04.681108', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-15 10:00:12,780] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (62, '2025-12-15 10:00:05.879122', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-15 10:00:21,481] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-15 10:00:22,389] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-15 10:00:27,382] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-15 10:00:27,581] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-16 06:00:14,779] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-16 06:00:18,883] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-16 07:00:10,779] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-16 07:00:15,183] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-16 08:00:16,179] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-16 08:00:16,783] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-16 08:00:20,383] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-16 08:00:21,080] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-16 09:00:04,494] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-16 09:00:08,179] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-16 10:00:08,979] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-16 10:00:10,679] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (30, '2025-12-16 10:00:02.785762', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-16 10:00:10,881] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (58, '2025-12-16 10:00:03.680433', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-16 10:00:11,380] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (72, '2025-12-16 10:00:03.985450', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-16 10:00:15,890] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-16 10:00:19,382] ERROR in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-16 10:00:21,978] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-17 06:00:09,981] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (54, '2025-12-17 06:00:02.680201', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-17 08:00:16,879] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-17 08:00:20,879] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-17 10:00:06,182] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-17 10:00:18,080] ERROR in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-18 06:00:09,483] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2025-12-18 06:00:02.582603', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-18 06:00:14,380] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-18 06:00:17,982] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-18 07:00:09,684] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-18 07:00:11,580] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-18 07:00:13,979] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-18 07:00:15,980] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-18 08:00:14,578] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-18 08:00:19,684] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-18 09:00:08,379] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-18 09:00:12,684] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-18 10:00:13,482] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2025-12-18 10:00:06.389530', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-18 10:00:13,788] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (37, '2025-12-18 10:00:05.984252', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-18 10:00:13,880] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (58, '2025-12-18 10:00:06.885931', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-18 10:00:23,182] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-18 10:00:29,679] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-19 06:00:10,281] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (45, '2025-12-19 06:00:02.982342', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-19 06:00:10,680] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (70, '2025-12-19 06:00:03.681274', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-19 06:00:10,781] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (62, '2025-12-19 06:00:03.385019', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-19 08:00:09,950] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (34, '2025-12-19 08:00:03.078754', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-19 08:00:10,282] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (45, '2025-12-19 08:00:02.981178', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-19 09:00:08,834] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-19 09:00:14,236] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-19 09:20:01,332] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-19 09:20:04,932] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-19 10:00:24,932] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-19 10:00:26,431] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-19 10:00:30,035] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-19 10:00:31,131] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-20 06:00:16,137] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (33, '2025-12-20 06:00:04.733023', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-20 08:00:14,433] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (58, '2025-12-20 08:00:06.434031', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-20 09:00:06,431] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-20 09:00:11,331] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-20 10:00:14,532] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (31, '2025-12-20 10:00:05.731033', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-20 10:00:27,133] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-20 10:00:32,431] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-20 11:20:01,136] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-20 11:20:04,834] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-21 06:00:20,732] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-21 06:00:25,132] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-21 08:00:21,034] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-21 08:00:25,933] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-21 09:00:05,133] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-21 09:00:10,532] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-21 09:20:01,131] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-21 09:20:05,233] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-21 10:00:14,332] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (62, '2025-12-21 10:00:06.338636', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-21 10:00:26,133] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-21 10:00:31,133] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-22 06:00:12,031] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (31, '2025-12-22 06:00:04.131623', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-22 07:00:16,432] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-22 07:00:17,033] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-22 07:00:20,733] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-22 07:00:21,133] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-22 08:00:19,736] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-22 08:00:21,631] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-22 08:00:23,231] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-22 08:00:26,031] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-22 08:00:27,939] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-22 10:00:14,532] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2025-12-22 10:00:06.834869', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-22 10:00:23,933] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-22 10:00:24,642] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-22 10:00:26,731] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-22 10:00:29,534] ERROR in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-22 10:00:29,634] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-22 10:00:31,332] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-23 06:00:18,931] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-23 06:00:26,434] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-23 08:00:19,131] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-23 08:00:24,732] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-23 08:00:30,034] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-23 09:20:01,235] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-23 09:20:05,134] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-23 10:00:15,632] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (37, '2025-12-23 10:00:08.832982', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-23 10:00:17,833] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (62, '2025-12-23 10:00:07.932252', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-23 10:00:24,735] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-23 10:00:28,537] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-23 10:00:30,934] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-23 10:00:32,732] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-24 06:00:20,533] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-24 06:00:25,635] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-24 07:00:12,633] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (61, '2025-12-24 07:00:05.331973', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-24 07:00:18,431] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-24 07:00:22,331] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-24 08:00:19,142] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-24 08:00:21,553] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-24 08:00:27,934] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-24 08:00:28,133] ERROR in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-24 10:00:28,835] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-24 10:00:32,336] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-25 06:00:13,633] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2025-12-25 06:00:05.834721', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-25 06:00:23,031] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-25 06:00:26,833] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-25 08:00:14,534] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (73, '2025-12-25 08:00:06.636698', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-25 08:00:14,534] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (74, '2025-12-25 08:00:06.831831', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-25 08:20:01,331] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-25 08:20:05,241] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-25 09:00:08,440] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-25 09:00:12,136] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-25 10:00:13,837] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (32, '2025-12-25 10:00:05.432721', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-25 10:00:21,231] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-25 10:00:24,533] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-25 10:00:28,636] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-26 06:00:19,034] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-26 06:00:24,134] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-26 08:00:13,051] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2025-12-26 08:00:05.431434', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-26 08:00:18,931] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-26 08:00:19,033] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-26 08:00:25,053] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-26 08:00:25,331] ERROR in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-26 09:00:08,431] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-26 09:00:13,133] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-26 09:20:01,031] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-26 09:20:05,336] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-26 10:00:13,938] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (37, '2025-12-26 10:00:07.134985', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-26 10:00:14,232] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2025-12-26 10:00:07.234777', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-26 10:00:22,535] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-26 10:00:27,633] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-27 06:00:13,442] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (62, '2025-12-27 06:00:06.937828', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-27 06:00:13,636] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (54, '2025-12-27 06:00:05.732786', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-27 06:00:13,641] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (58, '2025-12-27 06:00:06.032072', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-27 06:00:13,834] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (61, '2025-12-27 06:00:06.433671', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-27 06:00:14,332] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (31, '2025-12-27 06:00:05.632972', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-27 06:00:14,732] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (75, '2025-12-27 06:00:08.433907', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-27 06:00:18,850] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-27 06:00:23,833] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-27 07:00:18,332] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-27 07:00:22,632] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-27 08:00:12,937] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (45, '2025-12-27 08:00:06.036956', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-27 08:00:13,431] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (58, '2025-12-27 08:00:06.434036', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-27 08:00:13,534] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (34, '2025-12-27 08:00:05.231503', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-27 08:00:20,741] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-27 09:00:06,732] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-27 09:00:11,130] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-27 10:00:13,833] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2025-12-27 10:00:06.535361', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-27 10:00:13,936] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (30, '2025-12-27 10:00:05.334447', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-27 10:00:14,531] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (54, '2025-12-27 10:00:06.935185', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-27 10:00:19,231] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-27 10:00:20,734] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-27 10:00:24,635] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-27 10:00:26,331] ERROR in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-27 10:00:26,533] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-27 10:00:28,636] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-28 06:00:21,335] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-28 06:00:25,934] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-28 07:00:14,432] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-28 07:00:20,135] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-28 08:00:15,041] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2025-12-28 08:00:06.434609', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-28 08:00:18,731] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-28 08:00:25,133] ERROR in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-28 09:00:07,033] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-28 09:00:11,133] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-28 09:20:01,032] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-28 09:20:06,031] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-28 10:00:13,104] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2025-12-28 10:00:06.439180', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-28 10:00:14,432] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (37, '2025-12-28 10:00:06.634546', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-28 10:00:16,533] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (62, '2025-12-28 10:00:08.931943', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-28 10:00:25,232] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-28 10:00:28,731] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-29 06:00:22,842] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-29 06:00:27,233] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-29 07:00:17,332] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-29 07:00:18,335] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-29 07:00:22,742] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-29 07:00:22,833] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-29 08:00:20,431] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-29 08:00:20,731] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-29 08:00:26,535] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-29 09:00:07,633] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-29 09:00:12,135] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-29 10:00:13,633] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2025-12-29 10:00:06.232820', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-29 10:00:20,831] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-29 10:00:23,936] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-29 10:00:26,633] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-29 10:00:29,235] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-29 10:00:29,333] ERROR in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-29 10:00:30,533] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-30 06:00:14,032] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (62, '2025-12-30 06:00:05.834713', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-30 06:00:14,131] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (70, '2025-12-30 06:00:06.331285', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-30 07:00:16,031] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-30 07:00:18,033] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-30 07:00:21,133] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-30 07:00:21,833] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-30 08:00:17,531] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-30 08:00:20,532] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-30 08:00:25,932] ERROR in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-30 08:00:26,831] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-30 09:00:07,633] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-30 09:00:12,231] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-30 09:20:00,931] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-30 09:20:04,837] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2025-12-30 10:00:17,038] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (70, '2025-12-30 10:00:09.633396', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-30 10:00:17,532] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (73, '2025-12-30 10:00:09.732333', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-30 10:00:26,432] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-30 10:00:31,132] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-31 06:00:14,531] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (54, '2025-12-31 06:00:06.335964', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-31 06:00:14,631] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (58, '2025-12-31 06:00:06.434085', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-31 07:00:11,636] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (36, '2025-12-31 07:00:04.233914', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-31 07:00:11,637] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (54, '2025-12-31 07:00:04.535540', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-31 07:00:16,831] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-31 07:00:21,133] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-31 08:00:11,904] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (33, '2025-12-31 08:00:05.034286', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-31 08:00:12,331] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (25, '2025-12-31 08:00:05.832044', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-31 08:00:12,932] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (61, '2025-12-31 08:00:06.134395', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-31 08:00:13,538] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2025-12-31 08:00:05.332388', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2025-12-31 09:00:08,636] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-31 09:00:13,733] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-31 10:00:22,032] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-31 10:00:27,034] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-31 10:00:28,136] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2025-12-31 10:00:30,931] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-01 06:00:11,531] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (32, '2026-01-01 06:00:03.831266', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-01 06:00:12,031] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (26, '2026-01-01 06:00:03.531361', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-01 06:00:12,436] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (62, '2026-01-01 06:00:05.534660', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-01 07:00:12,233] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (73, '2026-01-01 07:00:05.635855', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-01 07:00:17,231] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-01 07:00:20,834] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-01 08:00:19,533] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-01 08:00:26,034] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-01 09:00:07,133] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-01 09:00:12,434] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-01 10:00:12,636] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (37, '2026-01-01 10:00:05.438404', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-01 10:00:13,534] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2026-01-01 10:00:06.231277', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-01 10:00:14,331] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (32, '2026-01-01 10:00:05.532183', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-01 10:00:14,438] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (62, '2026-01-01 10:00:06.736132', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-01 10:00:24,033] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-01 10:00:28,037] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-02 06:00:21,835] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-02 06:00:27,640] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-02 07:00:11,734] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (33, '2026-01-02 07:00:04.331360', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-02 08:00:21,241] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-02 08:00:26,331] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-02 09:00:07,932] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-02 09:00:12,234] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-02 10:00:29,535] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-02 10:00:33,331] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-03 06:00:21,532] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-03 06:00:24,136] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-03 06:00:27,030] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-03 06:00:28,532] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-03 08:00:12,031] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2026-01-03 08:00:05.233953', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-03 10:00:12,731] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (26, '2026-01-03 10:00:05.431267', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-03 10:00:15,231] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (58, '2026-01-03 10:00:07.431487', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-03 10:00:15,233] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (54, '2026-01-03 10:00:07.437895', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-04 06:00:19,834] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-04 06:00:24,933] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-04 07:00:15,433] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-04 07:00:20,233] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-04 08:00:12,736] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (26, '2026-01-04 08:00:04.334979', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-04 09:00:06,934] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-04 09:00:11,138] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-04 10:00:13,604] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (58, '2026-01-04 10:00:07.934302', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-04 10:00:25,631] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-04 10:00:30,032] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-05 06:00:13,033] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (37, '2026-01-05 06:00:05.535494', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-05 06:00:13,432] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (62, '2026-01-05 06:00:06.734301', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-05 06:00:13,534] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (45, '2026-01-05 06:00:05.934357', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-05 08:00:24,633] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-05 08:00:28,038] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-05 09:00:06,133] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-05 09:00:10,633] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-05 10:00:23,734] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-05 10:00:29,135] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-05 10:00:30,332] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-05 10:00:33,333] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-06 07:00:15,533] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-06 07:00:22,133] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-06 10:00:14,333] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2026-01-06 10:00:06.936763', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-06 10:00:14,504] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (45, '2026-01-06 10:00:07.631974', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-06 10:00:15,031] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (37, '2026-01-06 10:00:06.531638', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-06 10:00:15,331] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (58, '2026-01-06 10:00:07.135352', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-06 10:00:15,633] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (54, '2026-01-06 10:00:08.532937', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-06 10:00:21,734] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-06 10:00:26,231] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-07 06:00:18,332] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-07 06:00:25,133] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-07 07:00:15,333] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-07 07:00:19,532] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-07 09:00:06,733] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-07 09:00:11,130] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-07 10:00:22,031] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-07 10:00:27,631] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-07 10:00:27,832] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-07 10:00:31,438] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-08 06:00:20,132] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-08 06:00:25,436] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-08 07:00:15,433] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-08 07:00:19,938] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-08 08:00:19,831] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-08 08:00:24,934] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-08 09:00:05,533] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-08 09:00:10,830] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-08 10:00:13,731] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (32, '2026-01-08 10:00:05.534705', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-08 10:00:13,733] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (34, '2026-01-08 10:00:06.334548', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-08 10:00:25,533] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-08 10:00:29,933] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-09 07:00:12,533] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (75, '2026-01-09 07:00:04.738589', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-09 07:00:17,233] WARNING in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-09 07:00:17,235] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-09 07:00:21,632] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-09 07:00:21,934] ERROR in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-09 08:00:24,531] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-09 08:00:28,034] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-09 10:00:14,404] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2026-01-09 10:00:07.134103', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-09 10:00:14,431] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (34, '2026-01-09 10:00:06.734268', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-09 10:00:14,932] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (74, '2026-01-09 10:00:08.538383', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-09 10:00:15,633] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (32, '2026-01-09 10:00:05.734755', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-09 10:00:15,635] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (73, '2026-01-09 10:00:08.332240', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-09 10:00:16,331] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (62, '2026-01-09 10:00:08.531603', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-10 06:00:08,785] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (32, '2026-01-10 06:00:02.080594', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-10 06:00:15,878] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-10 06:00:20,582] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-10 07:00:11,881] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-10 07:00:15,578] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-10 08:00:08,552] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (32, '2026-01-10 08:00:01.884748', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-10 08:00:09,382] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2026-01-10 08:00:02.487629', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-10 08:00:09,978] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (37, '2026-01-10 08:00:02.281863', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-10 08:00:10,478] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (74, '2026-01-10 08:00:03.181899', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-10 08:20:00,478] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-10 08:20:03,583] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-11 06:00:13,183] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-11 06:00:18,683] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-11 08:00:11,653] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (61, '2026-01-11 08:00:03.682419', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-11 08:00:15,778] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-11 08:00:16,880] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-11 08:00:19,782] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-11 08:00:20,984] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-11 09:00:03,281] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-11 09:00:06,478] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-11 09:20:00,385] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-11 09:20:03,579] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-11 10:00:14,379] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-11 10:00:14,711] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-11 10:00:21,382] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-12 06:00:10,583] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-12 06:00:20,678] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-12 07:00:11,382] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-12 07:00:15,179] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-12 08:00:16,481] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-12 08:00:17,685] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-12 08:00:23,179] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-12 10:00:21,179] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-12 10:00:26,402] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-12 11:20:00,479] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-12 11:20:03,681] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-13 06:00:09,585] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (32, '2026-01-13 06:00:02.279172', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-13 06:00:09,678] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (61, '2026-01-13 06:00:02.988216', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-13 07:00:12,578] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-13 07:00:16,183] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-13 08:00:09,585] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (31, '2026-01-13 08:00:02.078698', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-13 08:00:12,383] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-13 08:00:18,888] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-13 08:00:22,291] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-13 08:20:00,478] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-13 08:20:03,680] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-13 09:00:03,681] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-13 09:00:06,882] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-13 10:00:10,879] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (61, '2026-01-13 10:00:03.881424', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-13 10:00:10,978] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (31, '2026-01-13 10:00:02.484631', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-13 10:00:11,085] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (72, '2026-01-13 10:00:04.180608', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-13 10:00:13,078] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-13 10:00:20,379] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-13 10:00:20,979] ERROR in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-13 10:00:23,883] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-14 06:00:15,600] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-14 06:00:16,279] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-14 06:00:19,579] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-14 06:00:20,480] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-14 07:00:11,781] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-14 07:00:15,080] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-14 08:00:10,351] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2026-01-14 08:00:03.082228', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-14 08:20:00,488] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-14 08:20:03,583] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-14 09:00:03,652] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-14 09:00:06,983] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-14 10:00:09,779] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2026-01-14 10:00:02.883863', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-14 10:00:10,384] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (62, '2026-01-14 10:00:03.283481', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-14 10:00:10,579] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (54, '2026-01-14 10:00:03.082677', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-14 10:00:10,680] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (31, '2026-01-14 10:00:03.080555', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-14 10:00:10,681] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (37, '2026-01-14 10:00:04.282378', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-14 10:00:10,681] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (70, '2026-01-14 10:00:04.181713', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-14 10:00:11,079] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (74, '2026-01-14 10:00:03.985219', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-15 06:00:12,624] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-15 06:00:13,524] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-15 06:00:17,921] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-15 06:00:18,121] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-15 07:00:08,922] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (72, '2026-01-15 07:00:02.122197', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-15 07:00:10,323] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-15 07:00:11,022] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-15 07:00:13,522] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-15 07:00:15,026] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-15 08:00:09,893] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (25, '2026-01-15 08:00:02.120934', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-15 08:00:10,523] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (37, '2026-01-15 08:00:02.823289', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-15 08:00:12,723] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (75, '2026-01-15 08:00:04.830698', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-15 08:00:15,321] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-15 08:00:18,725] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-15 08:20:00,329] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-15 08:20:03,522] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-15 10:00:16,922] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-15 10:00:21,921] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-16 08:00:10,725] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (37, '2026-01-16 08:00:04.023202', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-16 08:00:11,125] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (54, '2026-01-16 08:00:04.026997', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-16 08:20:00,422] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-16 08:20:03,623] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-16 10:00:16,620] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-16 10:00:21,922] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-17 06:00:09,024] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (33, '2026-01-17 06:00:01.923315', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-17 07:00:09,423] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-17 07:00:13,325] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-17 08:00:09,321] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (31, '2026-01-17 08:00:01.522958', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-17 08:00:09,322] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (26, '2026-01-17 08:00:01.723060', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-17 08:00:09,921] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-17 08:00:16,723] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-17 08:00:17,120] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-17 08:00:20,122] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-17 09:20:00,429] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-17 09:20:03,621] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-17 10:00:16,224] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-17 10:00:20,421] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-18 06:00:15,523] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-18 06:00:19,321] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-18 08:00:09,595] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (37, '2026-01-18 08:00:02.122049', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-18 08:00:10,523] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (75, '2026-01-18 08:00:03.824050', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-18 08:00:15,523] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-18 08:00:19,020] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-18 09:00:03,222] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-18 09:00:06,521] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-19 06:00:16,321] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-19 06:00:20,426] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-19 07:00:10,680] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-19 07:00:10,822] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-19 07:00:15,022] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-19 07:00:15,821] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-19 08:00:15,621] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-19 08:00:21,022] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-19 09:20:00,422] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-19 09:20:03,624] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-19 10:00:10,826] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (34, '2026-01-19 10:00:02.821850', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-19 10:00:11,622] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (62, '2026-01-19 10:00:03.228108', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-19 10:00:17,938] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-19 10:00:21,220] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-20 06:00:15,842] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-20 06:00:20,335] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-20 07:00:11,125] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-20 07:00:12,523] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-20 07:00:15,122] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-20 07:00:16,229] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-20 08:00:14,423] WARNING in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-20 08:00:15,223] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-20 08:00:15,824] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-20 08:00:19,826] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-20 08:00:20,121] ERROR in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-20 08:00:20,222] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-20 09:00:04,223] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-20 09:00:07,526] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-20 10:00:17,922] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-20 10:00:26,337] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-21 07:00:09,124] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-21 07:00:14,126] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-21 08:00:18,626] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-21 08:00:23,622] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-21 09:00:05,026] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-21 09:00:08,323] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-21 09:20:00,522] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-21 09:20:03,822] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-21 10:00:17,745] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-21 10:00:25,625] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-22 06:00:14,830] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-22 06:00:19,022] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-22 07:00:09,325] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (70, '2026-01-22 07:00:02.423250', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-22 07:00:09,497] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (75, '2026-01-22 07:00:02.926925', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-22 07:00:09,521] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (72, '2026-01-22 07:00:02.724759', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-22 08:00:09,423] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (33, '2026-01-22 08:00:02.321248', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-22 09:00:03,625] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-22 09:00:07,121] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-22 10:00:10,023] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (25, '2026-01-22 10:00:04.023838', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-22 10:00:10,526] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (33, '2026-01-22 10:00:03.622352', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-22 10:00:10,593] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (58, '2026-01-22 10:00:03.923655', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-22 10:00:10,923] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (62, '2026-01-22 10:00:04.522907', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-22 10:00:20,120] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-22 10:00:24,834] ERROR in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-23 06:00:09,193] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (32, '2026-01-23 06:00:01.923751', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-23 06:00:10,193] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (45, '2026-01-23 06:00:03.122505', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-23 06:00:12,022] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-23 06:00:13,021] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-23 06:00:16,821] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-23 06:00:16,823] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-23 07:00:10,824] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-23 07:00:12,423] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-23 07:00:15,022] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-23 07:00:16,522] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-23 08:00:10,328] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (31, '2026-01-23 08:00:02.420793', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-23 08:00:13,527] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-23 08:00:19,122] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-23 08:20:00,329] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-23 08:20:03,522] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-23 09:00:04,326] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-23 09:00:07,521] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-23 10:00:15,623] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-23 10:00:17,923] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-23 10:00:24,322] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-24 06:00:13,920] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-24 06:00:19,628] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-24 07:00:09,624] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-24 07:00:13,322] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-24 08:00:11,927] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-24 08:00:13,021] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-24 08:00:15,322] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-24 08:00:17,621] ERROR in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-24 08:00:17,923] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-24 08:00:19,827] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-24 09:00:03,526] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-24 09:00:06,726] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-24 10:00:12,425] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-24 10:00:15,121] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-24 10:00:15,323] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-24 10:00:20,824] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-24 10:00:20,826] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-25 06:00:09,624] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (25, '2026-01-25 06:00:02.421333', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-25 06:00:14,122] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-25 06:00:14,924] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-25 06:00:17,627] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-25 06:00:19,128] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-25 07:00:10,932] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-25 07:00:14,730] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-25 08:00:08,822] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (32, '2026-01-25 08:00:02.524160', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-25 08:00:09,021] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (33, '2026-01-25 08:00:02.321461', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-25 08:00:09,124] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2026-01-25 08:00:02.827754', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-25 08:00:09,124] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (37, '2026-01-25 08:00:03.125507', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-25 08:00:11,124] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (72, '2026-01-25 08:00:03.727046', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-25 09:00:02,822] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-25 09:00:06,026] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-25 10:00:09,621] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (62, '2026-01-25 10:00:02.928020', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-25 10:00:09,722] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2026-01-25 10:00:03.121421', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-25 10:00:09,925] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (70, '2026-01-25 10:00:03.524212', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-26 06:00:09,523] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (26, '2026-01-26 06:00:02.122001', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-26 06:00:14,121] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-26 06:00:18,422] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-26 07:00:08,822] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-26 07:00:09,424] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-26 07:00:13,223] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-26 07:00:13,523] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-26 08:00:09,724] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-26 08:00:10,928] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2026-01-26 08:00:03.434815', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-26 08:00:16,330] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-26 08:00:17,023] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-26 08:00:19,731] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-26 10:00:14,326] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-26 10:00:17,423] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-26 10:00:17,523] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-26 10:00:23,822] ERROR in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-26 10:00:24,021] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-26 10:00:24,023] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-27 06:00:14,938] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-27 06:00:18,933] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-27 07:00:08,132] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-27 07:00:10,033] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-27 07:00:12,831] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-27 07:00:13,345] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-27 08:00:15,842] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-27 08:00:16,031] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-27 08:00:19,835] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-27 08:00:20,332] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-27 09:00:02,831] WARNING in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-27 09:00:03,436] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-27 09:00:06,232] ERROR in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-27 09:00:06,832] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-27 10:00:15,033] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-27 10:00:19,652] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-28 06:00:14,234] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-28 06:00:18,031] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-28 07:00:10,035] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-28 07:00:14,242] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-28 08:00:10,032] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-28 08:00:12,436] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-28 08:00:15,835] WARNING in apscheduler: Fail to execute task #45 (carwow.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'carwow.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-28 08:00:18,332] ERROR in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-28 08:00:20,139] ERROR in apscheduler: Fail to execute task #45 (carwow.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'carwow.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-28 08:20:00,333] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-28 08:20:03,437] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-28 09:00:02,431] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-28 09:00:05,633] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-28 10:00:10,032] WARNING in apscheduler: Fail to execute task #45 (carwow.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'carwow.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-28 10:00:10,631] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2026-01-28 10:00:03.231299', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-28 10:00:13,447] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-28 10:00:17,234] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-28 10:00:17,235] ERROR in apscheduler: Fail to execute task #45 (carwow.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'carwow.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-28 10:00:20,333] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-28 10:00:22,033] ERROR in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-29 06:00:09,233] WARNING in apscheduler: Fail to execute task #45 (carwow.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'carwow.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-29 06:00:09,732] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (26, '2026-01-29 06:00:01.633605', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-29 06:00:15,644] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-29 06:00:16,332] ERROR in apscheduler: Fail to execute task #45 (carwow.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'carwow.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-29 06:00:18,934] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-29 07:00:09,435] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-29 07:00:14,040] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-29 08:00:08,534] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-29 08:00:11,333] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-29 08:00:11,633] WARNING in apscheduler: Fail to execute task #45 (carwow.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'carwow.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-29 08:00:16,531] ERROR in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-29 08:00:19,133] ERROR in apscheduler: Fail to execute task #45 (carwow.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'carwow.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-29 10:00:18,531] WARNING in apscheduler: Fail to execute task #45 (carwow.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'carwow.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-29 10:00:20,033] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-29 10:00:23,433] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-29 10:00:26,642] ERROR in apscheduler: Fail to execute task #45 (carwow.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'carwow.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-29 10:00:28,437] ERROR in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-29 10:00:29,334] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-30 06:00:13,432] WARNING in apscheduler: Fail to execute task #45 (carwow.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'carwow.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-30 06:00:14,132] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-30 06:00:18,234] ERROR in apscheduler: Fail to execute task #45 (carwow.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'carwow.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-30 06:00:18,531] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-30 08:00:17,732] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-30 08:00:18,432] WARNING in apscheduler: Fail to execute task #45 (carwow.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'carwow.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-30 08:00:22,336] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-30 08:00:24,731] ERROR in apscheduler: Fail to execute task #45 (carwow.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'carwow.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-30 10:00:10,311] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (54, '2026-01-30 10:00:04.031899', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-30 10:00:10,634] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (37, '2026-01-30 10:00:03.733539', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-30 10:00:11,232] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2026-01-30 10:00:04.437428', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-30 10:00:12,404] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (75, '2026-01-30 10:00:05.338626', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-01-30 10:00:13,632] WARNING in apscheduler: Fail to execute task #45 (carwow.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'carwow.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-30 10:00:18,332] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-30 10:00:20,230] ERROR in apscheduler: Fail to execute task #45 (carwow.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'carwow.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-01-30 10:00:22,333] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-30 21:00:03,637] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-30 21:00:07,235] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-31 06:00:12,532] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-31 06:00:19,633] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-31 09:00:03,033] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-31 09:00:06,632] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-31 10:00:08,332] WARNING in apscheduler: Fail to execute task #25 (auto1.es) on node 1, would retry later: Request got {'status_code': 500, 'status': 'error', 'message': '500 Internal Server Error: The server encountered an internal error and was unable to complete your request. Either the server is overloaded or there is an error in the application.'} [2026-01-31 10:00:13,134] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-01-31 10:00:21,034] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-01 06:00:13,238] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-01 06:00:14,933] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-01 06:00:17,040] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-01 06:00:19,134] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-01 08:00:11,041] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (33, '2026-02-01 08:00:02.331655', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-01 08:00:13,034] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-01 10:00:14,832] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-01 10:00:19,331] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-01 10:00:20,635] ERROR in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-01 10:00:23,235] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-02 06:00:13,338] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-02 06:00:13,435] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-02 06:00:17,865] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-02 06:00:18,948] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-02 07:00:10,933] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-02 07:00:15,631] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-02 08:00:16,133] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-02 08:00:21,531] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-02 09:00:02,933] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-02 09:00:06,235] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-02 10:00:09,704] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2026-02-02 10:00:03.531435', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-02 10:00:10,235] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (45, '2026-02-02 10:00:03.534549', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-02 10:00:10,331] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (30, '2026-02-02 10:00:03.033167', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-02 10:00:10,332] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (25, '2026-02-02 10:00:02.832699', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-02 10:00:10,334] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (58, '2026-02-02 10:00:03.833855', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-02 10:00:10,434] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-02 10:00:17,340] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-02 10:00:17,533] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-02 10:00:18,033] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-02 10:00:20,832] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-02 10:00:21,433] ERROR in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-03 06:00:15,632] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-03 06:00:19,637] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-03 07:00:10,032] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-03 07:00:14,944] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-03 08:00:16,035] WARNING in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-03 08:00:16,039] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-03 08:00:19,933] ERROR in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-03 08:00:20,041] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-03 09:00:05,632] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-03 09:00:08,934] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-03 10:00:10,032] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (33, '2026-02-03 10:00:02.634580', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-03 10:00:10,205] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2026-02-03 10:00:03.836609', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-03 10:00:10,332] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (31, '2026-02-03 10:00:03.434309', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-03 10:00:11,336] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (72, '2026-02-03 10:00:05.031372', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-03 10:00:11,432] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (70, '2026-02-03 10:00:04.834082', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-03 10:00:16,337] WARNING in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-03 10:00:19,639] ERROR in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-03 21:00:03,233] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-03 21:00:06,431] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-04 06:00:10,435] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-04 06:00:15,738] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-04 06:00:17,335] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-04 06:00:19,435] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-04 07:00:06,631] WARNING in apscheduler: Fail to execute task #25 (auto1.es) on node 1, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-02-04 07:00:14,632] ERROR in apscheduler: Fail to execute task #25 (auto1.es) on node 1, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-02-04 08:00:16,871] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-04 08:00:25,174] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 61, in main self.db_update_task_result() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 127, in db_update_task_result task = Task.query.get(self.task_id) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/query.py", line 1018, in get return self._get_impl(ident, loading.load_on_pk_identity) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/query.py", line 1135, in _get_impl return db_load_fn(self, primary_key_identity) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/loading.py", line 286, in load_on_pk_identity return q.one() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/query.py", line 3490, in one ret = self.one_or_none() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/query.py", line 3459, in one_or_none ret = list(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/query.py", line 3535, in __iter__ return self._execute_and_instances(context) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/query.py", line 3560, in _execute_and_instances result = conn.execute(querycontext.statement, self._params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: SELECT task.id AS task_id, task.name AS task_name, task."trigger" AS task_trigger, task.create_time AS task_create_time, task.update_time AS task_update_time, task.project AS task_project, task.version AS task_version, task.spider AS task_spider, task.jobid AS task_jobid, task.settings_arguments AS task_settings_arguments, task.selected_nodes AS task_selected_nodes, task.year AS task_year, task.month AS task_month, task.day AS task_day, task.week AS task_week, task.day_of_week AS task_day_of_week, task.hour AS task_hour, task.minute AS task_minute, task.second AS task_second, task.start_date AS task_start_date, task.end_date AS task_end_date, task.timezone AS task_timezone, task.jitter AS task_jitter, task.misfire_grace_time AS task_misfire_grace_time, task.coalesce AS task_coalesce, task.max_instances AS task_max_instances FROM task WHERE task.id = ?] [parameters: (74,)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-04 10:00:08,031] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-04 10:00:09,432] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2026-02-04 10:00:03.233250', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-04 10:00:10,132] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (54, '2026-02-04 10:00:03.436167', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-04 10:00:10,335] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (62, '2026-02-04 10:00:03.733118', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-04 10:00:10,931] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2026-02-04 10:00:03.131942', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-04 10:00:16,732] ERROR in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-04 10:00:18,131] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-04 10:00:22,332] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-05 06:00:15,034] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-05 06:00:18,834] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-05 07:00:13,032] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-05 07:00:16,551] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-05 08:00:10,035] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2026-02-05 08:00:03.032902', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-05 08:00:12,332] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-05 08:00:12,338] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-05 08:00:18,634] ERROR in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-05 08:00:19,235] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-06 07:00:11,432] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-06 07:00:15,537] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-06 08:00:12,537] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-06 08:00:20,232] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-06 09:00:04,171] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-06 09:00:07,332] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-06 10:00:11,834] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-06 10:00:14,639] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-06 10:00:16,634] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-06 10:00:20,632] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-06 10:00:20,633] ERROR in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-06 10:00:21,432] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-07 06:00:12,932] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-07 06:00:12,935] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-07 06:00:17,337] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-07 06:00:17,534] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-07 07:00:09,632] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-07 07:00:10,335] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-07 07:00:14,638] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-07 07:00:14,832] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-07 08:00:12,936] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-07 08:00:18,833] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-07 08:20:00,434] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-07 08:20:03,632] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-07 10:00:11,033] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-07 10:00:14,538] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-07 10:00:17,936] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-07 10:00:20,234] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-07 11:20:00,432] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-07 11:20:03,446] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-08 06:00:13,745] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-08 06:00:18,137] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-08 07:00:09,333] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-08 07:00:11,332] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-08 07:00:14,738] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-08 07:00:14,934] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-08 08:00:09,234] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-08 08:00:17,833] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-08 09:00:04,040] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-08 09:00:07,134] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-08 10:00:15,134] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-08 10:00:19,332] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-09 06:00:10,431] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2026-02-09 06:00:04.032468', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-09 06:00:13,434] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-09 06:00:15,333] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-09 06:00:17,932] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-09 06:00:18,932] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-09 07:00:11,434] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-09 07:00:11,533] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-09 07:00:15,434] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-09 07:00:15,436] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-09 08:00:15,333] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-09 08:00:20,133] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-09 09:00:04,533] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-09 09:00:07,833] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-09 10:00:10,621] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (62, '2026-02-09 10:00:04.135653', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-09 10:00:18,022] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-09 10:00:18,322] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-09 10:00:23,022] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-09 10:00:23,323] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-10 06:00:09,221] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (31, '2026-02-10 06:00:02.621865', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-10 06:00:17,121] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-10 06:00:20,625] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-10 08:00:08,922] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-10 08:00:09,721] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (34, '2026-02-10 08:00:03.023299', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-10 08:00:10,124] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2026-02-10 08:00:02.827430', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-10 08:00:10,293] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (58, '2026-02-10 08:00:03.124867', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-10 08:00:16,520] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-10 09:00:03,427] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-10 09:00:03,626] WARNING in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-10 09:00:06,621] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-10 09:00:07,023] ERROR in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-10 10:00:16,022] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-10 10:00:16,821] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-10 10:00:16,822] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-10 10:00:21,723] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-10 10:00:21,822] ERROR in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-10 10:00:22,122] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-10 11:20:00,429] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-10 11:20:03,629] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-11 06:00:15,431] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-11 06:00:19,233] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-11 07:00:08,242] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-11 07:00:14,334] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-11 09:00:06,132] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-11 09:00:09,547] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-11 10:00:18,434] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-11 10:00:19,132] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-11 10:00:26,633] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-11 10:00:26,732] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-12 06:00:15,031] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-12 06:00:17,936] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-12 06:00:20,135] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-12 06:00:21,632] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-12 07:00:04,033] WARNING in apscheduler: Fail to execute task #25 (auto1.es) on node 1, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-02-12 07:00:08,434] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-12 07:00:08,731] WARNING in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-12 07:00:08,931] WARNING in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-12 07:00:10,152] WARNING in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-12 07:00:11,031] ERROR in apscheduler: Fail to execute task #25 (auto1.es) on node 1, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-02-12 07:00:13,331] ERROR in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-12 07:00:13,735] ERROR in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-12 07:00:14,933] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-12 07:00:15,133] ERROR in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-12 09:00:05,333] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-12 09:00:08,738] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-12 09:37:56,248] WARNING in apscheduler: Update task #32 (vpauto.fr) successfully, next run at 2026-02-12 11:00:00+00:00. [2026-02-12 09:37:56,248] WARNING in apscheduler: Updated job_instance: { "id": "32", "kwargs": { "task_id": 32 }, "max_instances": 1, "misfire_grace_time": 600, "name": "vpauto.fr", "next_run_time": "datetime.datetime(2026, 2, 12, 11, 0, tzinfo=)", "trigger": "" } [2026-02-12 10:00:10,337] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2026-02-12 10:00:03.537141', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-12 10:00:10,735] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (62, '2026-02-12 10:00:04.036045', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-12 10:00:12,431] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-12 10:00:15,134] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-12 10:00:20,433] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-12 10:00:20,634] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-12 21:00:02,521] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-12 21:00:06,224] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-13 06:00:09,421] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2026-02-13 06:00:01.926670', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-13 07:00:11,622] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-13 07:00:12,121] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-13 07:00:15,221] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-13 07:00:16,322] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-13 08:00:13,522] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-13 08:00:17,725] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-13 09:00:02,220] WARNING in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-13 09:00:02,721] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-13 09:00:02,722] WARNING in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-13 09:00:05,421] ERROR in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-13 09:00:06,222] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-13 09:00:06,628] ERROR in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-13 10:00:11,024] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (72, '2026-02-13 10:00:03.625602', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-13 10:00:11,393] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (75, '2026-02-13 10:00:03.726189', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-13 10:00:12,423] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-13 10:00:13,740] WARNING in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-13 10:00:14,721] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-13 10:00:17,025] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-13 10:00:18,025] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-13 10:00:18,622] ERROR in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-14 06:00:08,926] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (37, '2026-02-14 06:00:02.524074', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-14 06:00:12,824] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-14 06:00:15,820] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-14 06:00:17,423] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-14 06:00:19,321] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-14 07:00:09,624] WARNING in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-14 07:00:11,023] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-14 07:00:11,025] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-14 07:00:11,223] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-14 07:00:12,321] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-14 07:00:14,920] ERROR in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-14 07:00:15,520] ERROR in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-14 07:00:16,122] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-14 07:00:16,626] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-14 07:00:16,822] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-14 08:00:13,227] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-14 08:00:19,523] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-14 09:00:03,424] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-14 09:00:07,122] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-14 10:00:09,723] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (58, '2026-02-14 10:00:02.921149', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-14 10:00:09,726] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (30, '2026-02-14 10:00:02.321676', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-14 11:20:00,531] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-14 11:20:03,726] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-15 06:00:10,025] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (37, '2026-02-15 06:00:02.521230', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-15 07:00:11,421] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-15 07:00:15,227] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-15 08:00:09,524] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (33, '2026-02-15 08:00:02.120872', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-15 08:00:09,820] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (75, '2026-02-15 08:00:03.221668', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-15 09:00:03,420] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-15 09:00:06,625] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-15 10:00:14,725] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-15 10:00:15,121] WARNING in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-15 10:00:15,522] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-15 10:00:19,921] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-15 10:00:20,530] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-15 10:00:20,721] ERROR in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-16 06:00:15,023] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-16 06:00:20,022] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-16 07:00:09,322] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-16 10:00:10,022] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (42, '2026-02-16 10:00:03.222874', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-16 10:00:11,121] WARNING in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-16 10:00:12,924] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-16 10:00:14,621] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-16 10:00:17,723] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-16 10:00:17,933] WARNING in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-16 10:00:19,725] ERROR in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-16 10:00:20,420] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-16 10:00:21,125] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-16 10:00:22,624] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-16 10:00:22,626] ERROR in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-17 07:00:05,122] WARNING in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-17 07:00:12,229] WARNING in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-17 07:00:12,323] ERROR in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-17 07:00:12,323] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-17 07:00:13,521] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-17 07:00:15,522] ERROR in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-17 07:00:16,021] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-17 07:00:16,723] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-17 08:00:05,224] WARNING in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-17 08:00:10,822] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2026-02-17 08:00:02.821233', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-17 08:00:14,722] ERROR in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-17 08:00:18,925] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-17 08:00:22,226] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-17 10:00:16,031] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-17 10:00:18,822] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-17 10:00:21,124] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-17 10:00:22,320] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-17 21:00:03,134] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-17 21:00:06,332] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-18 06:00:09,733] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (37, '2026-02-18 06:00:02.037233', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-18 06:00:10,931] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-18 06:00:16,435] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-18 07:00:04,335] WARNING in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-18 07:00:09,239] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-18 07:00:12,333] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-18 07:00:12,334] ERROR in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-18 07:00:12,833] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-18 07:00:13,832] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-18 07:00:16,036] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-18 07:00:16,532] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-18 09:00:04,350] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-18 09:00:07,932] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-18 09:20:00,437] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-18 09:20:03,735] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-18 10:00:06,537] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-18 10:00:18,332] ERROR in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-18 21:00:02,624] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-18 21:00:05,924] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-19 06:00:13,027] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-19 06:00:16,529] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-19 07:00:08,935] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-19 07:00:12,028] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-19 08:00:06,625] WARNING in apscheduler: Fail to execute task #44 (motorway.uk) on node 1, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'motorway.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-02-19 08:00:13,830] ERROR in apscheduler: Fail to execute task #44 (motorway.uk) on node 1, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'motorway.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-02-19 08:20:00,325] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-19 08:20:03,428] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-19 09:00:03,626] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-19 09:00:06,725] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-19 10:00:11,731] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-19 10:00:15,835] WARNING in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-19 10:00:18,725] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-19 10:00:19,829] ERROR in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-19 11:20:00,331] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-19 11:20:03,526] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-20 07:00:07,231] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-20 07:00:10,334] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-20 07:00:12,531] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-20 07:00:14,634] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-20 08:00:09,335] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (34, '2026-02-20 08:00:02.433214', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-20 08:00:15,634] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-20 08:00:16,334] WARNING in apscheduler: Fail to execute task #44 (motorway.uk) on node 1, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'motorway.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-02-20 08:00:19,637] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-20 08:00:20,334] ERROR in apscheduler: Fail to execute task #44 (motorway.uk) on node 1, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'motorway.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-02-20 09:00:03,937] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-20 09:00:07,336] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-20 09:20:00,338] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-20 09:20:03,532] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-20 10:00:15,334] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-20 10:00:20,337] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-20 21:00:03,236] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-20 21:00:06,431] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-21 06:00:14,347] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-21 06:00:18,033] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-21 07:00:08,237] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-21 07:00:12,832] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-21 08:00:09,059] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-21 08:00:09,445] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (45, '2026-02-21 08:00:02.134576', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-21 08:00:15,836] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-21 08:20:00,334] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-21 08:20:03,533] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-21 09:00:02,833] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-21 09:00:06,231] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-21 10:00:13,831] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-21 10:00:18,532] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-22 06:00:10,632] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-22 06:00:16,337] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-22 07:00:08,331] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-22 07:00:12,936] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-22 09:20:00,334] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-22 09:20:03,531] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-22 10:00:14,435] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-22 10:00:19,232] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-23 07:00:12,341] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-23 07:00:12,733] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-23 07:00:16,731] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-23 07:00:16,933] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-23 08:00:11,332] WARNING in apscheduler: Fail to execute task #44 (motorway.uk) on node 1, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'motorway.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-02-23 08:00:14,542] WARNING in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-23 08:00:14,735] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-23 08:00:17,936] ERROR in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-23 08:00:18,531] ERROR in apscheduler: Fail to execute task #44 (motorway.uk) on node 1, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'motorway.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-02-23 08:00:19,037] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-23 09:00:04,834] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-23 09:00:08,139] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-23 10:00:13,533] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-23 10:00:14,032] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-23 10:00:19,935] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-23 10:00:20,031] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-23 11:20:00,331] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-23 11:20:03,533] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-23 21:00:03,532] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-23 21:00:06,731] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-24 06:00:13,033] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-24 06:00:16,732] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-24 07:00:07,936] WARNING in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-24 07:00:08,135] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-24 07:00:08,433] WARNING in apscheduler: Fail to execute task #25 (auto1.es) on node 1, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-02-24 07:00:10,234] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-24 07:00:10,549] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-24 07:00:10,550] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-24 07:00:13,331] ERROR in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-24 07:00:13,534] ERROR in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-24 07:00:13,936] ERROR in apscheduler: Fail to execute task #25 (auto1.es) on node 1, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-02-24 07:00:14,834] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-24 07:00:15,432] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-24 07:00:15,533] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-24 08:00:10,436] WARNING in apscheduler: Fail to execute task #44 (motorway.uk) on node 1, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'motorway.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-02-24 08:00:13,033] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-24 08:00:16,630] ERROR in apscheduler: Fail to execute task #44 (motorway.uk) on node 1, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'motorway.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-02-24 08:00:18,533] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-24 09:00:03,632] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-24 09:00:06,836] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-24 09:20:00,532] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-24 09:20:03,731] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-24 10:00:09,331] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2026-02-24 10:00:02.634009', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-24 10:00:10,431] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (33, '2026-02-24 10:00:03.231249', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-24 21:00:03,833] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-24 21:00:07,033] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-25 06:00:09,937] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (37, '2026-02-25 06:00:02.433858', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-25 06:00:13,034] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-25 06:00:15,736] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-25 06:00:17,033] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-25 06:00:19,031] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-25 07:00:10,732] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-25 07:00:14,832] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-25 08:00:12,934] WARNING in apscheduler: Fail to execute task #44 (motorway.uk) on node 1, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'motorway.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-02-25 08:00:16,933] WARNING in apscheduler: Fail to execute task #72 (ayvens.be) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-25 08:00:17,733] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-25 08:00:21,331] ERROR in apscheduler: Fail to execute task #44 (motorway.uk) on node 1, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'motorway.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-02-25 08:00:22,635] ERROR in apscheduler: Fail to execute task #72 (ayvens.be) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-25 08:00:23,331] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-25 09:20:00,431] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-25 09:20:03,632] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-25 10:00:13,336] WARNING in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-25 10:00:20,233] ERROR in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-25 21:00:02,630] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-25 21:00:06,130] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-26 07:00:09,027] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-26 07:00:09,826] WARNING in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-26 07:00:10,452] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-26 07:00:11,125] WARNING in apscheduler: Fail to execute task #58 (ayvens.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-26 07:00:13,231] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-26 07:00:13,626] ERROR in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-26 07:00:14,429] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-26 07:00:14,930] ERROR in apscheduler: Fail to execute task #58 (ayvens.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-26 08:00:08,225] WARNING in apscheduler: Fail to execute task #26 (adesa.it) on node 1, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'adesa.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-02-26 08:00:09,827] WARNING in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-26 08:00:10,524] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-26 08:00:11,128] WARNING in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-26 08:00:11,824] WARNING in apscheduler: Fail to execute task #54 (ayvens.es) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-26 08:00:12,326] WARNING in apscheduler: Fail to execute task #73 (ayvens.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-26 08:00:12,326] WARNING in apscheduler: Fail to execute task #58 (ayvens.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-26 08:00:12,527] WARNING in apscheduler: Fail to execute task #72 (ayvens.be) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-26 08:00:12,927] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-26 08:00:13,326] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-26 08:00:13,528] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-26 08:00:13,625] WARNING in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-26 08:00:13,724] WARNING in apscheduler: Fail to execute task #44 (motorway.uk) on node 1, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'motorway.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-02-26 08:00:14,628] ERROR in apscheduler: Fail to execute task #26 (adesa.it) on node 1, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'adesa.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-02-26 08:00:16,125] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-26 08:00:16,628] ERROR in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-26 08:00:17,424] ERROR in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-26 08:00:18,725] ERROR in apscheduler: Fail to execute task #58 (ayvens.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-26 08:00:19,027] ERROR in apscheduler: Fail to execute task #54 (ayvens.es) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-26 08:00:19,226] ERROR in apscheduler: Fail to execute task #72 (ayvens.be) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-26 08:00:20,029] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-26 08:00:20,425] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-26 08:00:20,624] ERROR in apscheduler: Fail to execute task #73 (ayvens.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-26 08:00:21,024] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-26 08:00:21,325] ERROR in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-26 08:00:22,124] ERROR in apscheduler: Fail to execute task #44 (motorway.uk) on node 1, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'motorway.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-02-26 08:20:00,427] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-26 08:20:03,626] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-26 09:00:03,528] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-26 09:00:06,726] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-26 10:00:10,230] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (26, '2026-02-26 10:00:02.424521', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-26 11:20:00,428] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-26 11:20:03,724] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-26 21:00:04,025] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-26 21:00:07,531] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-26 23:00:01,027] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-26 23:00:04,331] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-27 06:00:14,024] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-27 06:00:17,926] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-27 07:00:09,226] WARNING in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-27 07:00:10,224] WARNING in apscheduler: Fail to execute task #58 (ayvens.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-27 07:00:10,444] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-27 07:00:11,624] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-27 07:00:11,824] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-27 07:00:11,827] WARNING in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-27 07:00:14,325] ERROR in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-27 07:00:14,328] ERROR in apscheduler: Fail to execute task #58 (ayvens.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-27 07:00:15,225] ERROR in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-27 07:00:16,126] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-27 07:00:16,425] ERROR in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-27 07:00:16,725] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-27 08:00:08,126] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (37, '2026-02-27 08:00:01.629118', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-02-27 08:00:14,725] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-27 08:00:19,230] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-27 09:00:04,126] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-27 09:00:07,428] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-27 10:00:18,025] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-27 10:00:22,227] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-28 06:00:11,425] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-28 06:00:15,825] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-28 07:00:10,626] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-28 07:00:11,527] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-28 07:00:12,335] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-28 07:00:14,424] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-28 07:00:15,325] ERROR in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-28 07:00:15,928] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-28 08:20:00,428] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-28 08:20:03,625] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-28 09:00:03,627] WARNING in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-28 09:00:06,925] ERROR in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-28 10:00:17,727] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-28 10:00:22,430] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-02-28 11:20:00,424] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-02-28 11:20:03,527] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-01 06:00:11,425] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-01 06:00:17,928] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-01 07:00:07,624] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-01 07:00:09,227] WARNING in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-01 07:00:13,125] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-01 07:00:14,828] ERROR in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-01 07:00:15,825] ERROR in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-01 07:00:16,828] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-01 08:00:07,027] WARNING in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-01 08:00:18,926] ERROR in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-01 10:00:20,328] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-01 10:00:24,526] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-01 11:20:00,524] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-01 11:20:03,825] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-01 17:00:01,226] WARNING in apscheduler: Fail to execute task #25 (auto1.es) on node 1, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-03-01 17:00:04,625] ERROR in apscheduler: Fail to execute task #25 (auto1.es) on node 1, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-03-02 06:00:13,328] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-02 06:00:18,028] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-02 07:00:07,125] WARNING in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-02 07:00:11,127] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-02 07:00:12,225] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-02 07:00:12,626] WARNING in apscheduler: Fail to execute task #73 (ayvens.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-02 07:00:12,727] WARNING in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-02 07:00:12,824] WARNING in apscheduler: Fail to execute task #72 (ayvens.be) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-02 07:00:13,224] ERROR in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-02 07:00:13,226] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-02 07:00:15,228] ERROR in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-02 07:00:16,329] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-02 07:00:16,825] ERROR in apscheduler: Fail to execute task #73 (ayvens.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-02 07:00:18,824] ERROR in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-02 07:00:19,024] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-02 07:00:19,027] ERROR in apscheduler: Fail to execute task #72 (ayvens.be) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-02 08:00:14,125] WARNING in apscheduler: Fail to execute task #44 (motorway.uk) on node 1, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'motorway.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-03-02 08:00:19,028] ERROR in apscheduler: Fail to execute task #44 (motorway.uk) on node 1, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'motorway.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-03-02 10:00:17,825] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-02 10:00:21,929] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-02 23:00:01,527] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-02 23:00:04,827] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-03 06:00:12,922] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-03 06:00:16,821] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-03 07:00:07,124] WARNING in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-03 07:00:09,023] WARNING in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-03 07:00:11,022] WARNING in apscheduler: Fail to execute task #73 (ayvens.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-03 07:00:11,223] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-03 07:00:11,621] WARNING in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-03 07:00:11,820] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-03 07:00:12,523] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-03 07:00:13,924] ERROR in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-03 07:00:15,622] ERROR in apscheduler: Fail to execute task #73 (ayvens.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-03 07:00:15,720] ERROR in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-03 07:00:16,924] ERROR in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-03 07:00:17,620] ERROR in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-03 07:00:17,921] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-03 07:00:18,322] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-03 08:00:14,222] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-03 08:00:14,524] WARNING in apscheduler: Fail to execute task #44 (motorway.uk) on node 1, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'motorway.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-03-03 08:00:18,222] ERROR in apscheduler: Fail to execute task #44 (motorway.uk) on node 1, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'motorway.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-03-03 08:00:18,825] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-03 11:20:00,426] WARNING in apscheduler: Fail to execute task #38 (bca.uk) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-03 11:20:03,732] ERROR in apscheduler: Fail to execute task #38 (bca.uk) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-03 20:00:03,722] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-03 20:00:03'} [2026-03-03 20:00:08,526] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-03 20:00:08'} [2026-03-03 21:00:06,445] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-03 21:00:11,722] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-04 06:00:10,421] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2026-03-04 06:00:02.522755', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-03-04 06:00:18,723] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-04 06:00:17'} [2026-03-04 06:00:25,923] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-04 06:00:26,127] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-04 06:00:25'} [2026-03-04 06:00:29,222] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-04 07:00:10,422] WARNING in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-04 07:00:17,023] WARNING in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-04 07:00:17,925] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-04 07:00:17'} [2026-03-04 07:00:18,323] WARNING in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-04 07:00:21,725] ERROR in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-04 07:00:26,826] WARNING in apscheduler: Fail to execute task #73 (ayvens.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-04 07:00:27,324] ERROR in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-04 07:00:27,924] ERROR in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-04 07:00:28,221] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-04 07:00:28,325] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-04 07:00:28'} [2026-03-04 07:00:28,730] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-04 07:00:30,824] ERROR in apscheduler: Fail to execute task #73 (ayvens.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-04 07:00:32,122] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-04 07:00:32,323] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-04 08:00:11,022] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (33, '2026-03-04 08:00:02.824807', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-03-04 08:00:11,927] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (72, '2026-03-04 08:00:04.625274', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-03-04 08:00:12,624] WARNING in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-04 08:00:14,623] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-04 08:00:13'} [2026-03-04 08:00:15,323] WARNING in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-04 08:00:15,821] WARNING in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-04 08:00:20,522] WARNING in apscheduler: Fail to execute task #63 (bca_logged_out.nl) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-04 08:00:23,121] ERROR in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-04 08:00:23,423] WARNING in apscheduler: Fail to execute task #71 (bca_logged_out.be) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-04 08:00:26,122] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-04 08:00:26,124] WARNING in apscheduler: Fail to execute task #75 (auto1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-04 08:00:26,221] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-04 08:00:26'} [2026-03-04 08:00:26,221] ERROR in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-04 08:00:26,223] WARNING in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-04 08:00:26,223] ERROR in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-04 08:00:26,642] ERROR in apscheduler: Fail to execute task #63 (bca_logged_out.nl) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-04 08:00:27,922] ERROR in apscheduler: Fail to execute task #71 (bca_logged_out.be) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-04 08:00:30,124] ERROR in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-04 08:00:30,229] ERROR in apscheduler: Fail to execute task #75 (auto1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-04 08:00:30,323] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-04 09:00:04,925] WARNING in apscheduler: Fail to execute task #39 (ecarstrade.be) on node 1, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ecarstrade.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-03-04 09:00:06,622] WARNING in apscheduler: Fail to execute task #63 (bca_logged_out.nl) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-04 09:00:07,121] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-04 09:00:11,824] ERROR in apscheduler: Fail to execute task #39 (ecarstrade.be) on node 1, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ecarstrade.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-03-04 09:00:12,121] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-04 09:00:12,323] ERROR in apscheduler: Fail to execute task #63 (bca_logged_out.nl) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-04 10:00:10,922] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (31, '2026-03-04 10:00:02.524669', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-03-04 10:00:12,922] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-04 10:00:20,424] WARNING in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-04 10:00:20,821] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-04 10:00:18'} [2026-03-04 10:00:23,221] ERROR in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-04 10:00:28,736] ERROR in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-04 10:00:29,624] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-04 10:00:29'} [2026-03-04 17:00:02,027] WARNING in apscheduler: Fail to execute task #25 (auto1.es) on node 1, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-03-04 17:00:05,522] ERROR in apscheduler: Fail to execute task #25 (auto1.es) on node 1, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-03-04 20:00:04,126] WARNING in apscheduler: Fail to execute task #26 (adesa.it) on node 1, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'adesa.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-03-04 20:00:05,722] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-04 20:00:05'} [2026-03-04 20:00:08,121] ERROR in apscheduler: Fail to execute task #26 (adesa.it) on node 1, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'adesa.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-03-04 20:00:09,829] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-04 20:00:09'} [2026-03-05 06:00:15,921] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-05 06:00:15'} [2026-03-05 06:00:24,723] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-05 06:00:24'} [2026-03-05 06:00:24,821] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-05 06:00:28,322] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-05 07:00:07,922] WARNING in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-05 07:00:10,622] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (32, '2026-03-05 07:00:02.321007', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-03-05 07:00:13,428] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-05 07:00:12'} [2026-03-05 07:00:15,924] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-05 07:00:16,123] WARNING in apscheduler: Fail to execute task #63 (bca_logged_out.nl) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-05 07:00:17,741] ERROR in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-05 07:00:18,022] WARNING in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-05 07:00:23,123] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-05 07:00:21'} [2026-03-05 07:00:25,021] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-05 07:00:25,427] ERROR in apscheduler: Fail to execute task #63 (bca_logged_out.nl) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-05 07:00:27,129] ERROR in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-05 08:00:11,124] WARNING in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-05 08:00:14,526] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-05 08:00:13'} [2026-03-05 08:00:18,129] WARNING in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-05 08:00:20,122] WARNING in apscheduler: Fail to execute task #63 (bca_logged_out.nl) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-05 08:00:21,926] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-05 08:00:23,520] ERROR in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-05 08:00:25,022] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-05 08:00:24'} [2026-03-05 08:00:26,522] ERROR in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-05 08:00:27,721] ERROR in apscheduler: Fail to execute task #63 (bca_logged_out.nl) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-05 08:00:28,521] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-05 09:00:07,727] WARNING in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-05 09:00:08,028] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-05 09:00:11,623] ERROR in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-05 09:00:12,123] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-05 10:00:08,726] WARNING in apscheduler: Fail to execute task #26 (adesa.it) on node 1, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'adesa.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-03-05 10:00:12,822] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (54, '2026-03-05 10:00:04.521231', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-03-05 10:00:12,924] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (31, '2026-03-05 10:00:03.420841', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-03-05 10:00:13,821] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-05 10:00:13'} [2026-03-05 10:00:13,822] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (58, '2026-03-05 10:00:04.724097', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-03-05 10:00:13,921] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (53, '2026-03-05 10:00:03.927342', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-03-05 10:00:13,923] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (52, '2026-03-05 10:00:04.222193', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-03-05 10:00:15,521] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 61, in main self.db_update_task_result() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 146, in db_update_task_result db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 230, in save_obj _emit_update_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 994, in _emit_update_statements c = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: UPDATE task_result SET pass_count=? WHERE task_result.id = ?] [parameters: (1, 34853)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-03-05 10:00:16,926] ERROR in apscheduler: Fail to execute task #26 (adesa.it) on node 1, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'adesa.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-03-05 10:00:21,021] WARNING in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-05 10:00:29,323] ERROR in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-05 10:00:29,821] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-05 10:00:28'} [2026-03-05 10:01:33,021] WARNING in apscheduler: EVENT_JOB_REMOVED: {'alias': None, 'code': 1024, 'job_id': '81', 'jobstore': 'default'} [2026-03-05 11:37:15,353] WARNING in apscheduler: Update task #74 (auto1.it) successfully, next run at 2026-03-05 21:10:00+00:00. [2026-03-05 11:37:15,354] WARNING in apscheduler: Updated job_instance: { "id": "74", "kwargs": { "task_id": 74 }, "max_instances": 1, "misfire_grace_time": 600, "name": "auto1.it", "next_run_time": "datetime.datetime(2026, 3, 5, 21, 10, tzinfo=)", "trigger": "" } [2026-03-05 11:39:08,520] WARNING in apscheduler: Update task #72 (ayvens.be) successfully, next run at 2026-03-05 20:00:00+00:00. [2026-03-05 11:39:08,520] WARNING in apscheduler: Updated job_instance: { "id": "72", "kwargs": { "task_id": 72 }, "max_instances": 1, "misfire_grace_time": 600, "name": "ayvens.be", "next_run_time": "datetime.datetime(2026, 3, 5, 20, 0, tzinfo=)", "trigger": "" } [2026-03-05 11:40:29,936] WARNING in apscheduler: Update task #71 (bca_logged_out.be) successfully, next run at 2026-03-05 21:20:00+00:00. [2026-03-05 11:40:29,936] WARNING in apscheduler: Updated job_instance: { "id": "71", "kwargs": { "task_id": 71 }, "max_instances": 1, "misfire_grace_time": 600, "name": "bca_logged_out.be", "next_run_time": "datetime.datetime(2026, 3, 5, 21, 20, tzinfo=)", "trigger": "" } [2026-03-05 11:42:34,720] WARNING in apscheduler: Update task #70 (bca_logged_out.it) successfully, next run at 2026-03-05 21:30:00+00:00. [2026-03-05 11:42:34,820] WARNING in apscheduler: Updated job_instance: { "id": "70", "kwargs": { "task_id": 70 }, "max_instances": 1, "misfire_grace_time": 600, "name": "bca_logged_out.it", "next_run_time": "datetime.datetime(2026, 3, 5, 21, 30, tzinfo=)", "trigger": "" } [2026-03-05 12:10:27,434] WARNING in apscheduler: Add task #83 (Batch0 Manheim) successfully, next run at 2026-03-06 05:30:00+00:00. [2026-03-05 12:10:27,435] WARNING in apscheduler: Added job_instance: { "id": "83", "kwargs": { "task_id": 83 }, "max_instances": 1, "misfire_grace_time": 600, "name": "Batch0 Manheim", "next_run_time": "datetime.datetime(2026, 3, 6, 5, 30, tzinfo=)", "trigger": "" } [2026-03-05 12:12:20,637] WARNING in apscheduler: Add task #84 (Batch1 Manheim) successfully, next run at 2026-03-06 05:20:00+00:00. [2026-03-05 12:12:20,638] WARNING in apscheduler: Added job_instance: { "id": "84", "kwargs": { "task_id": 84 }, "max_instances": 1, "misfire_grace_time": 600, "name": "Batch1 Manheim", "next_run_time": "datetime.datetime(2026, 3, 6, 5, 20, tzinfo=)", "trigger": "" } [2026-03-05 12:13:12,729] WARNING in apscheduler: Update task #83 (Batch0 Manheim) successfully, next run at 2026-03-06 05:30:00+00:00. [2026-03-05 12:13:12,729] WARNING in apscheduler: Updated job_instance: { "id": "83", "kwargs": { "task_id": 83 }, "max_instances": 1, "misfire_grace_time": 600, "name": "Batch0 Manheim", "next_run_time": "datetime.datetime(2026, 3, 6, 5, 30, tzinfo=)", "trigger": "" } [2026-03-05 12:14:59,532] WARNING in apscheduler: Add task #85 (Batch2 Manheim) successfully, next run at 2026-03-06 05:40:00+00:00. [2026-03-05 12:14:59,533] WARNING in apscheduler: Added job_instance: { "id": "85", "kwargs": { "task_id": 85 }, "max_instances": 1, "misfire_grace_time": 600, "name": "Batch2 Manheim", "next_run_time": "datetime.datetime(2026, 3, 6, 5, 40, tzinfo=)", "trigger": "" } [2026-03-05 12:16:24,022] WARNING in apscheduler: Update task #37 (manheim.gb) successfully, next run at 2026-03-05 20:00:00+00:00. [2026-03-05 12:16:24,023] WARNING in apscheduler: Updated job_instance: { "id": "37", "kwargs": { "task_id": 37 }, "max_instances": 1, "misfire_grace_time": 600, "name": "manheim.gb", "next_run_time": "datetime.datetime(2026, 3, 5, 20, 0, tzinfo=)", "trigger": "" } [2026-03-05 15:44:59,337] WARNING in apscheduler: Add task #86 (Batch0 Auto1FR) successfully, next run at 2026-03-06 05:00:00+00:00. [2026-03-05 15:44:59,338] WARNING in apscheduler: Added job_instance: { "id": "86", "kwargs": { "task_id": 86 }, "max_instances": 1, "misfire_grace_time": 600, "name": "Batch0 Auto1FR", "next_run_time": "datetime.datetime(2026, 3, 6, 5, 0, tzinfo=)", "trigger": "" } [2026-03-05 15:46:50,121] WARNING in apscheduler: Task #82 deleted. [2026-03-05 15:48:23,942] WARNING in apscheduler: Add task #87 (task_87) successfully, next run at 2026-03-06 05:10:00+00:00. [2026-03-05 15:48:23,942] WARNING in apscheduler: Added job_instance: { "id": "87", "kwargs": { "task_id": 87 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_87", "next_run_time": "datetime.datetime(2026, 3, 6, 5, 10, tzinfo=)", "trigger": "" } [2026-03-05 15:49:17,822] WARNING in apscheduler: Update task #87 (Batch1 Auto1FR) successfully, next run at 2026-03-06 05:10:00+00:00. [2026-03-05 15:49:17,822] WARNING in apscheduler: Updated job_instance: { "id": "87", "kwargs": { "task_id": 87 }, "max_instances": 1, "misfire_grace_time": 600, "name": "Batch1 Auto1FR", "next_run_time": "datetime.datetime(2026, 3, 6, 5, 10, tzinfo=)", "trigger": "" } [2026-03-05 16:44:13,634] WARNING in apscheduler: Add task #88 (task_88) successfully, next run at 2026-03-06 05:20:00+00:00. [2026-03-05 16:44:13,635] WARNING in apscheduler: Added job_instance: { "id": "88", "kwargs": { "task_id": 88 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_88", "next_run_time": "datetime.datetime(2026, 3, 6, 5, 20, tzinfo=)", "trigger": "" } [2026-03-05 16:45:47,336] WARNING in apscheduler: Update task #88 (Batch2 Auto1FR) successfully, next run at 2026-03-06 05:20:00+00:00. [2026-03-05 16:45:47,336] WARNING in apscheduler: Updated job_instance: { "id": "88", "kwargs": { "task_id": 88 }, "max_instances": 1, "misfire_grace_time": 600, "name": "Batch2 Auto1FR", "next_run_time": "datetime.datetime(2026, 3, 6, 5, 20, tzinfo=)", "trigger": "" } [2026-03-05 16:49:56,837] WARNING in apscheduler: Add task #89 (Batch3 Auto1FR) successfully, next run at 2026-03-06 05:30:00+00:00. [2026-03-05 16:49:56,837] WARNING in apscheduler: Added job_instance: { "id": "89", "kwargs": { "task_id": 89 }, "max_instances": 1, "misfire_grace_time": 600, "name": "Batch3 Auto1FR", "next_run_time": "datetime.datetime(2026, 3, 6, 5, 30, tzinfo=)", "trigger": "" } [2026-03-05 16:53:46,640] WARNING in apscheduler: Add task #90 (Batch4 Auto1FR) successfully, next run at 2026-03-06 05:40:00+00:00. [2026-03-05 16:53:46,641] WARNING in apscheduler: Added job_instance: { "id": "90", "kwargs": { "task_id": 90 }, "max_instances": 1, "misfire_grace_time": 600, "name": "Batch4 Auto1FR", "next_run_time": "datetime.datetime(2026, 3, 6, 5, 40, tzinfo=)", "trigger": "" } [2026-03-05 20:00:05,921] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-05 20:00:05'} [2026-03-05 20:00:09,526] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-05 20:00:09'} [2026-03-06 05:30:00,924] WARNING in apscheduler: Fail to execute task #89 (Batch3 Auto1FR) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-06 05:30:01,023] WARNING in apscheduler: Fail to execute task #83 (Batch0 Manheim) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-06 05:30:04,531] ERROR in apscheduler: Fail to execute task #83 (Batch0 Manheim) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-06 05:30:04,624] ERROR in apscheduler: Fail to execute task #89 (Batch3 Auto1FR) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-06 05:40:00,521] WARNING in apscheduler: Fail to execute task #90 (Batch4 Auto1FR) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-06 05:40:00,726] WARNING in apscheduler: Fail to execute task #85 (Batch2 Manheim) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-06 05:40:03,721] ERROR in apscheduler: Fail to execute task #90 (Batch4 Auto1FR) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-06 05:40:04,221] ERROR in apscheduler: Fail to execute task #85 (Batch2 Manheim) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-06 06:00:19,624] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-06 06:00:19'} [2026-03-06 06:00:19,920] WARNING in apscheduler: Fail to execute task #86 (Batch0 Auto1FR) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-06 06:00:23,227] ERROR in apscheduler: Fail to execute task #86 (Batch0 Auto1FR) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-06 06:00:24,038] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-06 06:00:24'} [2026-03-06 06:10:00,822] WARNING in apscheduler: Fail to execute task #87 (Batch1 Auto1FR) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-06 06:10:04,022] ERROR in apscheduler: Fail to execute task #87 (Batch1 Auto1FR) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-06 06:20:01,821] WARNING in apscheduler: Fail to execute task #88 (Batch2 Auto1FR) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-06 06:20:05,023] ERROR in apscheduler: Fail to execute task #88 (Batch2 Auto1FR) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-06 06:30:01,626] WARNING in apscheduler: Fail to execute task #89 (Batch3 Auto1FR) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-06 06:40:01,023] WARNING in apscheduler: Fail to execute task #85 (Batch2 Manheim) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-06 06:40:04,321] ERROR in apscheduler: Fail to execute task #85 (Batch2 Manheim) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-06 07:00:11,093] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (61, '2026-03-06 07:00:04.522852', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-03-06 07:00:14,622] WARNING in apscheduler: Fail to execute task #63 (bca_logged_out.nl) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-06 07:00:17,823] WARNING in apscheduler: Fail to execute task #67 (bca_logged_out.de) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.de' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-06 07:00:19,921] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-06 07:00:19'} [2026-03-06 07:00:20,722] ERROR in apscheduler: Fail to execute task #63 (bca_logged_out.nl) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-06 07:00:21,430] ERROR in apscheduler: Fail to execute task #67 (bca_logged_out.de) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.de' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-06 07:00:23,722] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-06 07:00:23'} [2026-03-06 07:10:00,424] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-06 07:10:03,621] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-06 07:30:00,430] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-06 07:30:03,821] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-06 08:00:10,823] WARNING in apscheduler: Fail to execute task #67 (bca_logged_out.de) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.de' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-06 08:00:13,125] WARNING in apscheduler: Fail to execute task #54 (ayvens.es) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-06 08:00:13,522] WARNING in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-06 08:00:13,525] WARNING in apscheduler: Fail to execute task #52 (autorola_logged_out.de) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.de' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-06 08:00:13,822] WARNING in apscheduler: Fail to execute task #51 (autorola_logged_out.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-06 08:00:15,322] WARNING in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-06 08:00:15,724] WARNING in apscheduler: Fail to execute task #73 (ayvens.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-06 08:00:15,821] WARNING in apscheduler: Fail to execute task #58 (ayvens.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-06 08:00:15,824] WARNING in apscheduler: Fail to execute task #63 (bca_logged_out.nl) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-06 08:00:16,256] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-06 08:00:14'} [2026-03-06 08:00:18,222] WARNING in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-06 08:00:19,323] ERROR in apscheduler: Fail to execute task #67 (bca_logged_out.de) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.de' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-06 08:00:21,720] ERROR in apscheduler: Fail to execute task #54 (ayvens.es) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-06 08:00:22,522] ERROR in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-06 08:00:22,643] ERROR in apscheduler: Fail to execute task #51 (autorola_logged_out.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-06 08:00:23,028] ERROR in apscheduler: Fail to execute task #52 (autorola_logged_out.de) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.de' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-06 08:00:23,426] ERROR in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-06 08:00:24,721] ERROR in apscheduler: Fail to execute task #63 (bca_logged_out.nl) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-06 08:00:24,824] ERROR in apscheduler: Fail to execute task #73 (ayvens.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-06 08:00:25,020] ERROR in apscheduler: Fail to execute task #58 (ayvens.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-06 08:00:26,927] ERROR in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-06 08:00:27,320] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-06 08:00:27'} [2026-03-06 08:10:01,724] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-06 08:10:05,023] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-06 10:00:10,322] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2026-03-06 10:00:02.922099', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-03-06 10:00:10,422] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (61, '2026-03-06 10:00:03.531643', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-03-06 10:00:10,823] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (53, '2026-03-06 10:00:02.725370', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-03-06 10:00:19,349] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-06 10:00:18'} [2026-03-06 10:00:23,422] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-06 10:00:23'} [2026-03-06 11:30:00,627] WARNING in apscheduler: Fail to execute task #83 (Batch0 Manheim) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-06 11:30:03,823] ERROR in apscheduler: Fail to execute task #83 (Batch0 Manheim) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-06 11:40:00,423] WARNING in apscheduler: Fail to execute task #85 (Batch2 Manheim) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-06 11:40:03,626] ERROR in apscheduler: Fail to execute task #85 (Batch2 Manheim) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-06 12:40:00,623] WARNING in apscheduler: Fail to execute task #90 (Batch4 Auto1FR) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-06 12:40:03,728] ERROR in apscheduler: Fail to execute task #90 (Batch4 Auto1FR) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-06 17:00:02,221] WARNING in apscheduler: Fail to execute task #25 (auto1.es) on node 1, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-03-06 17:00:05,622] ERROR in apscheduler: Fail to execute task #25 (auto1.es) on node 1, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-03-06 20:00:06,221] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-06 20:00:05'} [2026-03-06 20:00:09,646] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-06 20:00:09'} [2026-03-07 05:20:00,422] WARNING in apscheduler: Fail to execute task #88 (Batch2 Auto1FR) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-07 05:20:03,528] ERROR in apscheduler: Fail to execute task #88 (Batch2 Auto1FR) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-07 05:30:00,425] WARNING in apscheduler: Fail to execute task #89 (Batch3 Auto1FR) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-07 05:30:03,720] ERROR in apscheduler: Fail to execute task #89 (Batch3 Auto1FR) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-07 05:40:00,327] WARNING in apscheduler: Fail to execute task #90 (Batch4 Auto1FR) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-07 05:40:03,427] ERROR in apscheduler: Fail to execute task #90 (Batch4 Auto1FR) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-07 06:00:11,322] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (51, '2026-03-07 06:00:03.023923', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-03-07 06:00:13,321] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-07 06:00:12'} [2026-03-07 06:00:19,922] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-07 06:00:19'} [2026-03-07 06:10:00,922] WARNING in apscheduler: Fail to execute task #87 (Batch1 Auto1FR) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-07 06:10:04,027] ERROR in apscheduler: Fail to execute task #87 (Batch1 Auto1FR) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-07 06:20:01,621] WARNING in apscheduler: Fail to execute task #88 (Batch2 Auto1FR) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-07 06:20:04,923] ERROR in apscheduler: Fail to execute task #88 (Batch2 Auto1FR) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-07 06:30:02,221] WARNING in apscheduler: Fail to execute task #89 (Batch3 Auto1FR) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-07 06:30:05,922] ERROR in apscheduler: Fail to execute task #89 (Batch3 Auto1FR) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-07 06:40:00,329] WARNING in apscheduler: Fail to execute task #90 (Batch4 Auto1FR) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-07 06:40:03,528] ERROR in apscheduler: Fail to execute task #90 (Batch4 Auto1FR) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-07 07:00:08,322] WARNING in apscheduler: Fail to execute task #25 (auto1.es) on node 1, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-03-07 07:00:09,420] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-07 07:00:09,623] WARNING in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-07 07:00:11,521] WARNING in apscheduler: Fail to execute task #67 (bca_logged_out.de) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.de' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-07 07:00:11,524] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-07 07:00:14,731] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-07 07:00:12'} [2026-03-07 07:00:20,440] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-07 07:00:20,922] ERROR in apscheduler: Fail to execute task #25 (auto1.es) on node 1, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-03-07 07:00:21,622] ERROR in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-07 07:00:23,822] ERROR in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-07 07:00:24,124] ERROR in apscheduler: Fail to execute task #67 (bca_logged_out.de) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.de' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-07 07:00:25,420] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-07 07:00:25'} [2026-03-07 08:00:10,923] WARNING in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-07 08:00:13,125] WARNING in apscheduler: Fail to execute task #67 (bca_logged_out.de) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.de' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-07 08:00:15,623] WARNING in apscheduler: Fail to execute task #44 (motorway.uk) on node 1, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'motorway.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-03-07 08:00:16,423] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-07 08:00:14'} [2026-03-07 08:00:21,225] ERROR in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-07 08:00:22,121] ERROR in apscheduler: Fail to execute task #67 (bca_logged_out.de) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.de' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-07 08:00:22,422] ERROR in apscheduler: Fail to execute task #44 (motorway.uk) on node 1, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'motorway.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-03-07 08:00:22,624] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-07 08:00:22'} [2026-03-07 08:20:01,622] WARNING in apscheduler: Fail to execute task #88 (Batch2 Auto1FR) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-07 08:20:04,923] ERROR in apscheduler: Fail to execute task #88 (Batch2 Auto1FR) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-07 08:40:00,426] WARNING in apscheduler: Fail to execute task #90 (Batch4 Auto1FR) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-07 08:40:03,621] ERROR in apscheduler: Fail to execute task #90 (Batch4 Auto1FR) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-07 10:00:19,928] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-07 10:00:17'} [2026-03-07 10:00:23,825] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-07 10:00:23'} [2026-03-07 20:00:06,221] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-07 20:00:05'} [2026-03-07 20:00:09,526] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-07 20:00:09'} [2026-03-08 05:40:00,421] WARNING in apscheduler: Fail to execute task #90 (Batch4 Auto1FR) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-08 05:40:03,624] ERROR in apscheduler: Fail to execute task #90 (Batch4 Auto1FR) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-08 06:00:16,222] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-08 06:00:15'} [2026-03-08 06:00:20,325] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-08 06:00:20'} [2026-03-08 07:00:14,521] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-08 07:00:13'} [2026-03-08 07:00:21,625] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-08 07:00:21'} [2026-03-08 08:00:11,221] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (53, '2026-03-08 08:00:03.621050', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-03-08 08:00:21,424] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-08 08:00:19'} [2026-03-08 08:00:25,126] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-08 08:00:25'} [2026-03-08 10:00:20,421] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-08 10:00:18'} [2026-03-08 10:00:23,725] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-08 10:00:23'} [2026-03-08 20:00:06,322] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-08 20:00:05'} [2026-03-08 20:00:10,121] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-08 20:00:10'} [2026-03-09 05:30:00,921] WARNING in apscheduler: Fail to execute task #83 (Batch0 Manheim) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-09 05:30:04,124] ERROR in apscheduler: Fail to execute task #83 (Batch0 Manheim) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-09 05:40:00,824] WARNING in apscheduler: Fail to execute task #85 (Batch2 Manheim) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-09 05:40:04,122] ERROR in apscheduler: Fail to execute task #85 (Batch2 Manheim) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-09 06:00:09,126] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (33, '2026-03-09 06:00:02.020773', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-03-09 06:00:10,293] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (60, '2026-03-09 06:00:03.423174', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-03-09 06:00:10,621] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (53, '2026-03-09 06:00:03.621060', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-03-09 06:40:01,221] WARNING in apscheduler: Fail to execute task #85 (Batch2 Manheim) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-09 06:40:05,121] ERROR in apscheduler: Fail to execute task #85 (Batch2 Manheim) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-09 07:00:17,722] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-09 07:00:15'} [2026-03-09 07:00:24,630] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-09 07:00:24'} [2026-03-09 07:10:00,521] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-09 07:10:03,724] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-09 08:00:16,921] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-09 08:00:15'} [2026-03-09 08:00:24,921] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-09 08:00:24'} [2026-03-09 10:00:10,430] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (33, '2026-03-09 10:00:03.423406', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-03-09 10:00:11,021] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (53, '2026-03-09 10:00:03.721477', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-03-09 10:00:18,329] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-09 10:00:16'} [2026-03-09 10:00:23,825] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-09 10:00:23'} [2026-03-09 11:30:00,626] WARNING in apscheduler: Fail to execute task #83 (Batch0 Manheim) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-09 11:30:04,621] ERROR in apscheduler: Fail to execute task #83 (Batch0 Manheim) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-09 11:40:00,421] WARNING in apscheduler: Fail to execute task #85 (Batch2 Manheim) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-09 11:40:03,625] ERROR in apscheduler: Fail to execute task #85 (Batch2 Manheim) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-09 12:20:00,422] WARNING in apscheduler: Fail to execute task #88 (Batch2 Auto1FR) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-09 12:20:03,722] ERROR in apscheduler: Fail to execute task #88 (Batch2 Auto1FR) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-09 20:00:04,321] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-09 20:00:04'} [2026-03-09 20:00:08,220] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-09 20:00:08'} [2026-03-10 05:30:00,926] WARNING in apscheduler: Fail to execute task #89 (Batch3 Auto1FR) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-10 05:30:04,324] ERROR in apscheduler: Fail to execute task #89 (Batch3 Auto1FR) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-10 05:40:01,021] WARNING in apscheduler: Fail to execute task #85 (Batch2 Manheim) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-10 05:40:04,322] ERROR in apscheduler: Fail to execute task #85 (Batch2 Manheim) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-10 06:00:18,923] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-10 06:00:17'} [2026-03-10 06:00:24,622] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-10 06:00:24'} [2026-03-10 06:30:01,622] WARNING in apscheduler: Fail to execute task #83 (Batch0 Manheim) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-10 06:30:04,923] ERROR in apscheduler: Fail to execute task #83 (Batch0 Manheim) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-10 06:40:01,021] WARNING in apscheduler: Fail to execute task #85 (Batch2 Manheim) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-10 06:40:04,925] ERROR in apscheduler: Fail to execute task #85 (Batch2 Manheim) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-10 07:00:07,221] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-10 07:00:06'} [2026-03-10 07:00:08,821] WARNING in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-10 07:00:09,322] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (33, '2026-03-10 07:00:02.226432', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-03-10 07:00:21,435] ERROR in apscheduler: Fail to execute task #32 (vpauto.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'vpauto.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-10 07:00:21,820] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-10 07:00:21'} [2026-03-10 08:00:11,693] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (45, '2026-03-10 08:00:05.126845', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-03-10 08:00:13,223] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (67, '2026-03-10 08:00:06.327819', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-03-10 08:00:13,421] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (60, '2026-03-10 08:00:06.121355', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-03-10 08:00:21,821] WARNING in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-10 08:00:26,024] ERROR in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-10 08:10:01,626] WARNING in apscheduler: Fail to execute task #74 (auto1.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-10 08:10:01,822] WARNING in apscheduler: Fail to execute task #87 (Batch1 Auto1FR) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-10 08:10:05,124] ERROR in apscheduler: Fail to execute task #74 (auto1.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-10 08:10:05,522] ERROR in apscheduler: Fail to execute task #87 (Batch1 Auto1FR) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-10 08:20:01,824] WARNING in apscheduler: Fail to execute task #71 (bca_logged_out.be) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-10 08:20:01,922] WARNING in apscheduler: Fail to execute task #88 (Batch2 Auto1FR) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-10 08:20:05,521] ERROR in apscheduler: Fail to execute task #88 (Batch2 Auto1FR) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-10 08:20:05,824] ERROR in apscheduler: Fail to execute task #71 (bca_logged_out.be) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-10 08:30:01,521] WARNING in apscheduler: Fail to execute task #89 (Batch3 Auto1FR) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-10 08:30:02,021] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-10 08:30:05,524] ERROR in apscheduler: Fail to execute task #89 (Batch3 Auto1FR) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-10 08:30:05,724] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-10 08:40:05,521] WARNING in apscheduler: Fail to execute task #90 (Batch4 Auto1FR) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-10 08:40:11,220] ERROR in apscheduler: Fail to execute task #90 (Batch4 Auto1FR) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-10 09:00:05,222] WARNING in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-10 09:00:05,920] WARNING in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-10 09:00:06,122] WARNING in apscheduler: Fail to execute task #63 (bca_logged_out.nl) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-10 09:00:08,732] ERROR in apscheduler: Fail to execute task #33 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-10 09:00:09,922] ERROR in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-10 09:00:10,121] ERROR in apscheduler: Fail to execute task #63 (bca_logged_out.nl) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-10 09:30:00,623] WARNING in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-10 09:30:03,825] ERROR in apscheduler: Fail to execute task #70 (bca_logged_out.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-10 10:00:08,421] WARNING in apscheduler: Fail to execute task #51 (autorola_logged_out.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-10 10:00:08,423] WARNING in apscheduler: Fail to execute task #58 (ayvens.it) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-10 10:00:10,723] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (54, '2026-03-10 10:00:03.824725', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-03-10 10:00:10,925] WARNING in apscheduler: Fail to execute task #73 (ayvens.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-10 10:00:11,021] WARNING in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-10 10:00:11,024] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (44, '2026-03-10 10:00:03.224598', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-03-10 10:00:11,623] ERROR in apscheduler: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 170, in execute_task task_executor.main() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 43, in main self.get_task_result_id() File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 70, in get_task_result_id db.session.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/scoping.py", line 163, in do return getattr(self.registry(), name)(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 1046, in commit self.transaction.commit() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 504, in commit self._prepare_impl() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl self.session.flush() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2681, in _flush with util.safe_reraise(): File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 239, in save_obj _emit_insert_statements( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/persistence.py", line 1135, in _emit_insert_statements result = cached_connections[connection].execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked [SQL: INSERT INTO task_result (task_id, execute_time, fail_count, pass_count) VALUES (?, ?, ?, ?)] [parameters: (67, '2026-03-10 10:00:05.026429', 0, 0)] (Background on this error at: http://sqlalche.me/e/13/e3q8) [2026-03-10 10:00:12,025] WARNING in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-10 10:00:17,124] WARNING in apscheduler: Fail to execute task #63 (bca_logged_out.nl) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-10 10:00:19,331] WARNING in apscheduler: Fail to execute task #52 (autorola_logged_out.de) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.de' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-10 10:00:19,525] ERROR in apscheduler: Fail to execute task #58 (ayvens.it) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.it' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-10 10:00:19,826] WARNING in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-10 10:00:20,024] WARNING in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-10 10:00:20,421] ERROR in apscheduler: Fail to execute task #51 (autorola_logged_out.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-10 10:00:20,624] WARNING in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-10 10:00:20,827] ERROR in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-10 10:00:21,322] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-10 10:00:19'} [2026-03-10 10:00:21,621] ERROR in apscheduler: Fail to execute task #61 (bca_logged_out.es) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.es' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-10 10:00:21,724] ERROR in apscheduler: Fail to execute task #73 (ayvens.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ayvens.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-10 10:00:23,520] ERROR in apscheduler: Fail to execute task #63 (bca_logged_out.nl) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-10 10:00:25,121] ERROR in apscheduler: Fail to execute task #49 (autorola_logged_out.nl) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-10 10:00:25,322] ERROR in apscheduler: Fail to execute task #52 (autorola_logged_out.de) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.de' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-10 10:00:25,521] ERROR in apscheduler: Fail to execute task #31 (auto1.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-10 10:00:26,424] ERROR in apscheduler: Fail to execute task #53 (autorola_logged_out.be) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'autorola_logged_out.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-3:6800/schedule.json'} [2026-03-10 10:00:27,344] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-3:6800/schedule.json', 'when': '2026-03-10 10:00:27'} [2026-03-10 12:10:00,427] WARNING in apscheduler: Fail to execute task #87 (Batch1 Auto1FR) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-10 12:10:03,720] ERROR in apscheduler: Fail to execute task #87 (Batch1 Auto1FR) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-10 12:20:02,025] WARNING in apscheduler: Fail to execute task #88 (Batch2 Auto1FR) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-10 12:20:06,021] ERROR in apscheduler: Fail to execute task #88 (Batch2 Auto1FR) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-10 12:40:01,526] WARNING in apscheduler: Fail to execute task #90 (Batch4 Auto1FR) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-10 12:40:05,324] ERROR in apscheduler: Fail to execute task #90 (Batch4 Auto1FR) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-11 19:00:00,130] WARNING in apscheduler: Fail to execute task #36 (astonbarclay.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'astonbarclay.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-03-11 19:00:03,197] ERROR in apscheduler: Fail to execute task #36 (astonbarclay.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'astonbarclay.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-03-11 20:00:01,032] WARNING in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-03-11 20:00:01,137] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-2:6800/schedule.json', 'when': '2026-03-11 20:00:01'} [2026-03-11 20:00:04,165] ERROR in apscheduler: Fail to execute task #37 (manheim.gb) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-03-11 20:00:04,370] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-2:6800/schedule.json', 'when': '2026-03-11 20:00:04'} [2026-03-12 06:00:02,343] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-2:6800/schedule.json', 'when': '2026-03-12 06:00:01'} [2026-03-12 06:00:06,826] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-2:6800/schedule.json', 'when': '2026-03-12 06:00:06'} [2026-03-12 06:20:00,538] WARNING in apscheduler: Fail to execute task #88 (Batch2 Auto1FR) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-03-12 06:20:03,657] ERROR in apscheduler: Fail to execute task #88 (Batch2 Auto1FR) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-03-12 06:40:00,127] WARNING in apscheduler: Fail to execute task #90 (Batch4 Auto1FR) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-03-12 06:40:03,167] ERROR in apscheduler: Fail to execute task #90 (Batch4 Auto1FR) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-03-12 07:00:01,726] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-2:6800/schedule.json', 'when': '2026-03-12 07:00:01'} [2026-03-12 07:00:03,169] WARNING in apscheduler: Fail to execute task #63 (bca_logged_out.nl) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-12 07:00:04,925] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-2:6800/schedule.json', 'when': '2026-03-12 07:00:04'} [2026-03-12 07:00:06,447] ERROR in apscheduler: Fail to execute task #63 (bca_logged_out.nl) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.nl' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-12 08:00:02,957] WARNING in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-12 08:00:04,302] WARNING in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, would retry later: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-2:6800/schedule.json', 'when': '2026-03-12 08:00:03'} [2026-03-12 08:00:04,542] WARNING in apscheduler: Fail to execute task #67 (bca_logged_out.de) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.de' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-12 08:00:06,754] ERROR in apscheduler: Fail to execute task #62 (bca_logged_out.fr) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-12 08:00:07,734] ERROR in apscheduler: Fail to execute task #67 (bca_logged_out.de) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca_logged_out.de' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-12 08:00:07,830] ERROR in apscheduler: Fail to execute task #60 (ayvens.se) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "spider 'ayvens.se' not found", 'status': 'error', 'status_code': 200, 'url': 'http://scrapyd-2:6800/schedule.json', 'when': '2026-03-12 08:00:07'} [2026-03-12 08:10:00,245] WARNING in apscheduler: Fail to execute task #87 (Batch1 Auto1FR) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-03-12 08:10:03,344] ERROR in apscheduler: Fail to execute task #87 (Batch1 Auto1FR) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-03-12 08:20:00,426] WARNING in apscheduler: Fail to execute task #88 (Batch2 Auto1FR) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-03-12 08:20:03,451] ERROR in apscheduler: Fail to execute task #88 (Batch2 Auto1FR) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-03-12 08:30:00,545] WARNING in apscheduler: Fail to execute task #89 (Batch3 Auto1FR) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-03-12 08:30:03,567] ERROR in apscheduler: Fail to execute task #89 (Batch3 Auto1FR) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-03-12 08:40:00,067] WARNING in apscheduler: Fail to execute task #90 (Batch4 Auto1FR) on node 2, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-03-12 08:40:03,087] ERROR in apscheduler: Fail to execute task #90 (Batch4 Auto1FR) on node 2, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.fr' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-1:6800/schedule.json'} [2026-03-12 08:58:27,268] WARNING in apscheduler: Task #1 deleted. [2026-03-12 08:58:31,355] WARNING in apscheduler: Task #2 deleted. [2026-03-12 08:58:31,914] WARNING in apscheduler: Task #3 deleted. [2026-03-12 08:58:32,446] WARNING in apscheduler: Task #4 deleted. [2026-03-12 08:58:32,886] WARNING in apscheduler: Task #5 deleted. [2026-03-12 08:58:33,502] WARNING in apscheduler: Task #6 deleted. [2026-03-12 08:58:34,071] WARNING in apscheduler: Task #7 deleted. [2026-03-12 08:58:34,949] WARNING in apscheduler: Task #8 deleted. [2026-03-12 08:58:35,949] WARNING in apscheduler: Task #9 deleted. [2026-03-12 08:58:36,917] WARNING in apscheduler: Task #27 deleted. [2026-03-12 08:58:37,354] WARNING in apscheduler: Task #26 deleted. [2026-03-12 08:58:37,521] WARNING in apscheduler: Task #25 deleted. [2026-03-12 08:58:37,776] WARNING in apscheduler: Task #24 deleted. [2026-03-12 08:58:38,200] WARNING in apscheduler: Task #23 deleted. [2026-03-12 08:58:38,418] WARNING in apscheduler: Task #22 deleted. [2026-03-12 08:58:38,631] WARNING in apscheduler: Task #21 deleted. [2026-03-12 08:58:38,803] WARNING in apscheduler: Task #20 deleted. [2026-03-12 08:58:39,002] WARNING in apscheduler: Task #19 deleted. [2026-03-12 08:58:39,166] WARNING in apscheduler: Task #18 deleted. [2026-03-12 08:58:39,354] WARNING in apscheduler: Task #17 deleted. [2026-03-12 08:58:39,552] WARNING in apscheduler: Task #16 deleted. [2026-03-12 08:58:39,732] WARNING in apscheduler: Task #15 deleted. [2026-03-12 08:58:39,914] WARNING in apscheduler: Task #14 deleted. [2026-03-12 08:58:40,105] WARNING in apscheduler: Task #13 deleted. [2026-03-12 08:58:40,281] WARNING in apscheduler: Task #12 deleted. [2026-03-12 08:58:40,601] WARNING in apscheduler: Task #11 deleted. [2026-03-12 08:58:41,002] WARNING in apscheduler: Task #10 deleted. [2026-03-12 09:06:20,743] WARNING in apscheduler: Add task #1 (batch0) successfully, next run at 2026-03-12 12:00:00+00:00. [2026-03-12 09:06:20,744] WARNING in apscheduler: Added job_instance: { "id": "1", "kwargs": { "task_id": 1 }, "max_instances": 4, "misfire_grace_time": 600, "name": "batch0", "next_run_time": "datetime.datetime(2026, 3, 12, 12, 0, tzinfo=)", "trigger": "" } [2026-03-12 09:21:29,301] WARNING in apscheduler: Add task #2 (batch3) successfully, next run at 2026-03-12 12:05:00+00:00. [2026-03-12 09:21:29,301] WARNING in apscheduler: Added job_instance: { "id": "2", "kwargs": { "task_id": 2 }, "max_instances": 4, "misfire_grace_time": 600, "name": "batch3", "next_run_time": "datetime.datetime(2026, 3, 12, 12, 5, tzinfo=)", "trigger": "" } [2026-03-12 09:22:39,613] WARNING in apscheduler: Update task #2 (batch3) successfully, next run at 2026-03-12 12:15:00+00:00. [2026-03-12 09:22:39,613] WARNING in apscheduler: Updated job_instance: { "id": "2", "kwargs": { "task_id": 2 }, "max_instances": 4, "misfire_grace_time": 600, "name": "batch3", "next_run_time": "datetime.datetime(2026, 3, 12, 12, 15, tzinfo=)", "trigger": "" } [2026-03-12 09:23:01,852] WARNING in apscheduler: Add task #3 (batch3) successfully, next run at 2026-03-12 12:05:00+00:00. [2026-03-12 09:23:01,852] WARNING in apscheduler: Added job_instance: { "id": "3", "kwargs": { "task_id": 3 }, "max_instances": 4, "misfire_grace_time": 600, "name": "batch3", "next_run_time": "datetime.datetime(2026, 3, 12, 12, 5, tzinfo=)", "trigger": "" } [2026-03-12 09:23:17,530] WARNING in apscheduler: Update task #3 (batch1) successfully, next run at 2026-03-12 12:05:00+00:00. [2026-03-12 09:23:17,530] WARNING in apscheduler: Updated job_instance: { "id": "3", "kwargs": { "task_id": 3 }, "max_instances": 4, "misfire_grace_time": 600, "name": "batch1", "next_run_time": "datetime.datetime(2026, 3, 12, 12, 5, tzinfo=)", "trigger": "" } [2026-03-12 09:29:39,141] WARNING in apscheduler: Add task #4 (batch2) successfully, next run at 2026-03-12 12:10:00+00:00. [2026-03-12 09:29:39,142] WARNING in apscheduler: Added job_instance: { "id": "4", "kwargs": { "task_id": 4 }, "max_instances": 4, "misfire_grace_time": 600, "name": "batch2", "next_run_time": "datetime.datetime(2026, 3, 12, 12, 10, tzinfo=)", "trigger": "" } [2026-03-12 09:30:56,027] WARNING in apscheduler: Add task #5 (batch0) successfully, next run at 2026-03-12 11:00:00+00:00. [2026-03-12 09:30:56,028] WARNING in apscheduler: Added job_instance: { "id": "5", "kwargs": { "task_id": 5 }, "max_instances": 4, "misfire_grace_time": 600, "name": "batch0", "next_run_time": "datetime.datetime(2026, 3, 12, 11, 0, tzinfo=)", "trigger": "" } [2026-03-12 09:38:06,964] WARNING in apscheduler: Add task #6 (batch1) successfully, next run at 2026-03-12 11:05:00+00:00. [2026-03-12 09:38:06,964] WARNING in apscheduler: Added job_instance: { "id": "6", "kwargs": { "task_id": 6 }, "max_instances": 4, "misfire_grace_time": 600, "name": "batch1", "next_run_time": "datetime.datetime(2026, 3, 12, 11, 5, tzinfo=)", "trigger": "" } [2026-03-12 10:10:20,242] WARNING in apscheduler: Add task #7 (batch2) successfully, next run at 2026-03-12 11:10:00+00:00. [2026-03-12 10:10:20,243] WARNING in apscheduler: Added job_instance: { "id": "7", "kwargs": { "task_id": 7 }, "max_instances": 4, "misfire_grace_time": 600, "name": "batch2", "next_run_time": "datetime.datetime(2026, 3, 12, 11, 10, tzinfo=)", "trigger": "" } [2026-03-12 10:13:57,418] WARNING in apscheduler: Add task #8 (batch3) successfully, next run at 2026-03-12 11:15:00+00:00. [2026-03-12 10:13:57,419] WARNING in apscheduler: Added job_instance: { "id": "8", "kwargs": { "task_id": 8 }, "max_instances": 4, "misfire_grace_time": 600, "name": "batch3", "next_run_time": "datetime.datetime(2026, 3, 12, 11, 15, tzinfo=)", "trigger": "" } [2026-03-12 10:55:34,031] WARNING in apscheduler: Add task #9 (task_9) successfully, next run at 2026-03-12 13:00:00+00:00. [2026-03-12 10:55:34,031] WARNING in apscheduler: Added job_instance: { "id": "9", "kwargs": { "task_id": 9 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_9", "next_run_time": "datetime.datetime(2026, 3, 12, 13, 0, tzinfo=)", "trigger": "" } [2026-03-12 10:59:11,191] WARNING in apscheduler: Add task #10 (task_10) successfully, next run at 2026-03-12 13:30:00+00:00. [2026-03-12 10:59:11,192] WARNING in apscheduler: Added job_instance: { "id": "10", "kwargs": { "task_id": 10 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_10", "next_run_time": "datetime.datetime(2026, 3, 12, 13, 30, tzinfo=)", "trigger": "" } [2026-03-12 11:11:09,025] WARNING in apscheduler: Add task #11 (task_11) successfully, next run at 2026-03-12 14:30:00+00:00. [2026-03-12 11:11:09,025] WARNING in apscheduler: Added job_instance: { "id": "11", "kwargs": { "task_id": 11 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_11", "next_run_time": "datetime.datetime(2026, 3, 12, 14, 30, tzinfo=)", "trigger": "" } [2026-03-12 11:17:56,870] WARNING in apscheduler: Add task #12 (batch0) successfully, next run at 2026-03-12 15:00:00+00:00. [2026-03-12 11:17:56,871] WARNING in apscheduler: Added job_instance: { "id": "12", "kwargs": { "task_id": 12 }, "max_instances": 4, "misfire_grace_time": 600, "name": "batch0", "next_run_time": "datetime.datetime(2026, 3, 12, 15, 0, tzinfo=)", "trigger": "" } [2026-03-12 11:20:50,320] WARNING in apscheduler: Add task #13 (batch1) successfully, next run at 2026-03-12 15:05:00+00:00. [2026-03-12 11:20:50,321] WARNING in apscheduler: Added job_instance: { "id": "13", "kwargs": { "task_id": 13 }, "max_instances": 4, "misfire_grace_time": 600, "name": "batch1", "next_run_time": "datetime.datetime(2026, 3, 12, 15, 5, tzinfo=)", "trigger": "" } [2026-03-12 11:23:37,084] WARNING in apscheduler: Add task #14 (batch3) successfully, next run at 2026-03-12 15:15:00+00:00. [2026-03-12 11:23:37,084] WARNING in apscheduler: Added job_instance: { "id": "14", "kwargs": { "task_id": 14 }, "max_instances": 4, "misfire_grace_time": 600, "name": "batch3", "next_run_time": "datetime.datetime(2026, 3, 12, 15, 15, tzinfo=)", "trigger": "" } [2026-03-12 11:27:19,275] WARNING in apscheduler: Add task #15 (batch2) successfully, next run at 2026-03-12 15:10:00+00:00. [2026-03-12 11:27:19,324] WARNING in apscheduler: Added job_instance: { "id": "15", "kwargs": { "task_id": 15 }, "max_instances": 4, "misfire_grace_time": 600, "name": "batch2", "next_run_time": "datetime.datetime(2026, 3, 12, 15, 10, tzinfo=)", "trigger": "" } [2026-03-12 11:29:20,642] WARNING in apscheduler: Add task #16 (task_16) successfully, next run at 2026-03-12 14:00:00+00:00. [2026-03-12 11:29:20,642] WARNING in apscheduler: Added job_instance: { "id": "16", "kwargs": { "task_id": 16 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_16", "next_run_time": "datetime.datetime(2026, 3, 12, 14, 0, tzinfo=)", "trigger": "" } [2026-03-12 11:35:45,791] WARNING in apscheduler: Add task #17 (batch0) successfully, next run at 2026-03-12 18:30:00+00:00. [2026-03-12 11:35:45,791] WARNING in apscheduler: Added job_instance: { "id": "17", "kwargs": { "task_id": 17 }, "max_instances": 2, "misfire_grace_time": 600, "name": "batch0", "next_run_time": "datetime.datetime(2026, 3, 12, 18, 30, tzinfo=)", "trigger": "" } [2026-03-12 11:38:07,950] WARNING in apscheduler: Add task #18 (batch1) successfully, next run at 2026-03-12 18:35:00+00:00. [2026-03-12 11:38:07,950] WARNING in apscheduler: Added job_instance: { "id": "18", "kwargs": { "task_id": 18 }, "max_instances": 2, "misfire_grace_time": 600, "name": "batch1", "next_run_time": "datetime.datetime(2026, 3, 12, 18, 35, tzinfo=)", "trigger": "" } [2026-03-12 11:42:58,980] WARNING in apscheduler: Add task #19 (task_19) successfully, next run at 2026-03-12 17:00:00+00:00. [2026-03-12 11:42:58,981] WARNING in apscheduler: Added job_instance: { "id": "19", "kwargs": { "task_id": 19 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_19", "next_run_time": "datetime.datetime(2026, 3, 12, 17, 0, tzinfo=)", "trigger": "" } [2026-03-12 11:51:13,936] WARNING in apscheduler: Add task #20 (task_20) successfully, next run at 2026-03-12 12:00:00+00:00. [2026-03-12 11:51:13,937] WARNING in apscheduler: Added job_instance: { "id": "20", "kwargs": { "task_id": 20 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_20", "next_run_time": "datetime.datetime(2026, 3, 12, 12, 0, tzinfo=)", "trigger": "" } [2026-03-12 11:57:20,665] WARNING in apscheduler: Add task #21 (batch0) successfully, next run at 2026-03-12 14:00:00+00:00. [2026-03-12 11:57:20,665] WARNING in apscheduler: Added job_instance: { "id": "21", "kwargs": { "task_id": 21 }, "max_instances": 2, "misfire_grace_time": 600, "name": "batch0", "next_run_time": "datetime.datetime(2026, 3, 12, 14, 0, tzinfo=)", "trigger": "" } [2026-03-12 11:57:48,117] WARNING in apscheduler: Add task #22 (batch1) successfully, next run at 2026-03-12 14:05:00+00:00. [2026-03-12 11:57:48,118] WARNING in apscheduler: Added job_instance: { "id": "22", "kwargs": { "task_id": 22 }, "max_instances": 2, "misfire_grace_time": 600, "name": "batch1", "next_run_time": "datetime.datetime(2026, 3, 12, 14, 5, tzinfo=)", "trigger": "" } [2026-03-12 12:05:05,740] WARNING in apscheduler: Add task #23 (batch1) successfully, next run at 2026-03-12 15:05:00+00:00. [2026-03-12 12:05:05,742] WARNING in apscheduler: Added job_instance: { "id": "23", "kwargs": { "task_id": 23 }, "max_instances": 2, "misfire_grace_time": 600, "name": "batch1", "next_run_time": "datetime.datetime(2026, 3, 12, 15, 5, tzinfo=)", "trigger": "" } [2026-03-12 12:05:41,650] WARNING in apscheduler: Add task #24 (batch0) successfully, next run at 2026-03-12 15:00:00+00:00. [2026-03-12 12:05:41,651] WARNING in apscheduler: Added job_instance: { "id": "24", "kwargs": { "task_id": 24 }, "max_instances": 2, "misfire_grace_time": 600, "name": "batch0", "next_run_time": "datetime.datetime(2026, 3, 12, 15, 0, tzinfo=)", "trigger": "" } [2026-03-12 12:15:44,329] WARNING in apscheduler: Add task #25 (batch0) successfully, next run at 2026-03-12 20:30:00+00:00. [2026-03-12 12:15:44,331] WARNING in apscheduler: Added job_instance: { "id": "25", "kwargs": { "task_id": 25 }, "max_instances": 2, "misfire_grace_time": 600, "name": "batch0", "next_run_time": "datetime.datetime(2026, 3, 12, 20, 30, tzinfo=)", "trigger": "" } [2026-03-12 12:16:01,712] WARNING in apscheduler: Add task #26 (batch1) successfully, next run at 2026-03-12 20:35:00+00:00. [2026-03-12 12:16:01,712] WARNING in apscheduler: Added job_instance: { "id": "26", "kwargs": { "task_id": 26 }, "max_instances": 2, "misfire_grace_time": 600, "name": "batch1", "next_run_time": "datetime.datetime(2026, 3, 12, 20, 35, tzinfo=)", "trigger": "" } [2026-03-12 12:18:56,256] WARNING in apscheduler: Add task #27 (batch0) successfully, next run at 2026-03-12 19:00:00+00:00. [2026-03-12 12:18:56,257] WARNING in apscheduler: Added job_instance: { "id": "27", "kwargs": { "task_id": 27 }, "max_instances": 2, "misfire_grace_time": 600, "name": "batch0", "next_run_time": "datetime.datetime(2026, 3, 12, 19, 0, tzinfo=)", "trigger": "" } [2026-03-12 12:20:59,046] WARNING in apscheduler: Add task #28 (batch1) successfully, next run at 2026-03-12 19:10:00+00:00. [2026-03-12 12:20:59,046] WARNING in apscheduler: Added job_instance: { "id": "28", "kwargs": { "task_id": 28 }, "max_instances": 2, "misfire_grace_time": 600, "name": "batch1", "next_run_time": "datetime.datetime(2026, 3, 12, 19, 10, tzinfo=)", "trigger": "" } [2026-03-12 12:29:00,877] WARNING in apscheduler: Add task #29 (task_29) successfully, next run at 2026-03-12 14:00:00+00:00. [2026-03-12 12:29:00,878] WARNING in apscheduler: Added job_instance: { "id": "29", "kwargs": { "task_id": 29 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_29", "next_run_time": "datetime.datetime(2026, 3, 12, 14, 0, tzinfo=)", "trigger": "" } [2026-03-12 12:29:05,410] WARNING in apscheduler: Add task #30 (task_30) successfully, next run at 2026-03-12 17:30:00+00:00. [2026-03-12 12:29:05,411] WARNING in apscheduler: Added job_instance: { "id": "30", "kwargs": { "task_id": 30 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_30", "next_run_time": "datetime.datetime(2026, 3, 12, 17, 30, tzinfo=)", "trigger": "" } [2026-03-12 12:56:05,824] WARNING in apscheduler: Add task #31 (task_31) successfully, next run at 2026-03-12 15:15:00+00:00. [2026-03-12 12:56:05,827] WARNING in apscheduler: Added job_instance: { "id": "31", "kwargs": { "task_id": 31 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_31", "next_run_time": "datetime.datetime(2026, 3, 12, 15, 15, tzinfo=)", "trigger": "" } [2026-03-12 12:56:15,373] WARNING in apscheduler: Add task #32 (task_32) successfully, next run at 2026-03-12 13:00:00+00:00. [2026-03-12 12:56:15,373] WARNING in apscheduler: Added job_instance: { "id": "32", "kwargs": { "task_id": 32 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_32", "next_run_time": "datetime.datetime(2026, 3, 12, 13, 0, tzinfo=)", "trigger": "" } [2026-03-12 12:57:49,577] WARNING in apscheduler: Add task #33 (task_33) successfully, next run at 2026-03-12 14:30:00+00:00. [2026-03-12 12:57:49,577] WARNING in apscheduler: Added job_instance: { "id": "33", "kwargs": { "task_id": 33 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_33", "next_run_time": "datetime.datetime(2026, 3, 12, 14, 30, tzinfo=)", "trigger": "" } [2026-03-12 12:58:00,192] WARNING in apscheduler: Add task #34 (task_34) successfully, next run at 2026-03-12 13:45:00+00:00. [2026-03-12 12:58:00,192] WARNING in apscheduler: Added job_instance: { "id": "34", "kwargs": { "task_id": 34 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_34", "next_run_time": "datetime.datetime(2026, 3, 12, 13, 45, tzinfo=)", "trigger": "" } [2026-03-12 13:01:19,014] WARNING in apscheduler: Add task #35 (task_35) successfully, next run at 2026-03-12 14:45:00+00:00. [2026-03-12 13:01:19,014] WARNING in apscheduler: Added job_instance: { "id": "35", "kwargs": { "task_id": 35 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_35", "next_run_time": "datetime.datetime(2026, 3, 12, 14, 45, tzinfo=)", "trigger": "" } [2026-03-12 13:14:04,035] WARNING in apscheduler: Add task #36 (task_36) successfully, next run at 2026-03-12 17:00:00+00:00. [2026-03-12 13:14:04,036] WARNING in apscheduler: Added job_instance: { "id": "36", "kwargs": { "task_id": 36 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_36", "next_run_time": "datetime.datetime(2026, 3, 12, 17, 0, tzinfo=)", "trigger": "" } [2026-03-12 13:14:19,973] WARNING in apscheduler: Add task #37 (task_37) successfully, next run at 2026-03-12 16:00:00+00:00. [2026-03-12 13:14:19,974] WARNING in apscheduler: Added job_instance: { "id": "37", "kwargs": { "task_id": 37 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_37", "next_run_time": "datetime.datetime(2026, 3, 12, 16, 0, tzinfo=)", "trigger": "" } [2026-03-12 13:14:47,479] WARNING in apscheduler: Add task #38 (task_38) successfully, next run at 2026-03-12 13:30:00+00:00. [2026-03-12 13:14:47,480] WARNING in apscheduler: Added job_instance: { "id": "38", "kwargs": { "task_id": 38 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_38", "next_run_time": "datetime.datetime(2026, 3, 12, 13, 30, tzinfo=)", "trigger": "" } [2026-03-12 13:15:39,723] WARNING in apscheduler: Add task #39 (task_39) successfully, next run at 2026-03-12 16:30:00+00:00. [2026-03-12 13:15:39,724] WARNING in apscheduler: Added job_instance: { "id": "39", "kwargs": { "task_id": 39 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_39", "next_run_time": "datetime.datetime(2026, 3, 12, 16, 30, tzinfo=)", "trigger": "" } [2026-03-12 13:18:06,882] WARNING in apscheduler: Add task #40 (task_40) successfully, next run at 2026-03-12 17:15:00+00:00. [2026-03-12 13:18:06,883] WARNING in apscheduler: Added job_instance: { "id": "40", "kwargs": { "task_id": 40 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_40", "next_run_time": "datetime.datetime(2026, 3, 12, 17, 15, tzinfo=)", "trigger": "" } [2026-03-12 13:18:17,264] WARNING in apscheduler: Add task #41 (task_41) successfully, next run at 2026-03-12 13:30:00+00:00. [2026-03-12 13:18:17,265] WARNING in apscheduler: Added job_instance: { "id": "41", "kwargs": { "task_id": 41 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_41", "next_run_time": "datetime.datetime(2026, 3, 12, 13, 30, tzinfo=)", "trigger": "" } [2026-03-12 13:19:47,786] WARNING in apscheduler: Add task #42 (task_42) successfully, next run at 2026-03-12 16:00:00+00:00. [2026-03-12 13:19:47,786] WARNING in apscheduler: Added job_instance: { "id": "42", "kwargs": { "task_id": 42 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_42", "next_run_time": "datetime.datetime(2026, 3, 12, 16, 0, tzinfo=)", "trigger": "" } [2026-03-12 13:20:02,836] WARNING in apscheduler: Add task #43 (task_43) successfully, next run at 2026-03-12 14:45:00+00:00. [2026-03-12 13:20:02,839] WARNING in apscheduler: Added job_instance: { "id": "43", "kwargs": { "task_id": 43 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_43", "next_run_time": "datetime.datetime(2026, 3, 12, 14, 45, tzinfo=)", "trigger": "" } [2026-03-12 13:20:25,772] WARNING in apscheduler: Add task #44 (task_44) successfully, next run at 2026-03-12 13:45:00+00:00. [2026-03-12 13:20:25,772] WARNING in apscheduler: Added job_instance: { "id": "44", "kwargs": { "task_id": 44 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_44", "next_run_time": "datetime.datetime(2026, 3, 12, 13, 45, tzinfo=)", "trigger": "" } [2026-03-12 13:24:44,572] WARNING in apscheduler: Add task #45 (task_45) successfully, next run at 2026-03-12 15:30:00+00:00. [2026-03-12 13:24:44,572] WARNING in apscheduler: Added job_instance: { "id": "45", "kwargs": { "task_id": 45 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_45", "next_run_time": "datetime.datetime(2026, 3, 12, 15, 30, tzinfo=)", "trigger": "" } [2026-03-12 16:30:00,277] WARNING in apscheduler: Fail to execute task #33 (None) on node 5, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ecarstrade.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-4:6800/schedule.json'} [2026-03-12 16:30:03,295] ERROR in apscheduler: Fail to execute task #33 (None) on node 5, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ecarstrade.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-4:6800/schedule.json'} [2026-03-13 11:10:00,191] WARNING in apscheduler: Fail to execute task #7 (batch2) on node 1, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 4.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-0:6800/schedule.json'} [2026-03-13 11:10:03,237] ERROR in apscheduler: Fail to execute task #7 (batch2) on node 1, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 4.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-0:6800/schedule.json'} [2026-03-13 11:15:00,230] WARNING in apscheduler: Fail to execute task #8 (batch3) on node 1, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 4.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-0:6800/schedule.json'} [2026-03-13 11:15:03,525] ERROR in apscheduler: Fail to execute task #8 (batch3) on node 1, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'manheim.gb' has reached the limit 4.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-0:6800/schedule.json'} [2026-03-13 16:30:00,333] WARNING in apscheduler: Fail to execute task #33 (None) on node 5, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ecarstrade.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-4:6800/schedule.json'} [2026-03-13 16:30:03,349] ERROR in apscheduler: Fail to execute task #33 (None) on node 5, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ecarstrade.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-4:6800/schedule.json'} [2026-03-15 07:35:00,053] WARNING in apscheduler: Fail to execute task #18 (batch1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.de' has reached the limit 2.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-15 07:35:03,069] ERROR in apscheduler: Fail to execute task #18 (batch1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.de' has reached the limit 2.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-16 12:42:14,490] WARNING in apscheduler: Add task #46 (task_46) successfully, next run at 2026-03-16 16:00:00+00:00. [2026-03-16 12:42:14,491] WARNING in apscheduler: Added job_instance: { "id": "46", "kwargs": { "task_id": 46 }, "max_instances": 3, "misfire_grace_time": 600, "name": "task_46", "next_run_time": "datetime.datetime(2026, 3, 16, 16, 0, tzinfo=)", "trigger": "" } [2026-03-16 12:43:30,851] WARNING in apscheduler: Add task #47 (task_47) successfully, next run at 2026-03-17 06:00:00+00:00. [2026-03-16 12:43:30,852] WARNING in apscheduler: Added job_instance: { "id": "47", "kwargs": { "task_id": 47 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_47", "next_run_time": "datetime.datetime(2026, 3, 17, 6, 0, tzinfo=)", "trigger": "" } [2026-03-16 12:47:15,225] WARNING in apscheduler: Add task #48 (task_48) successfully, next run at 2026-03-16 20:00:00+00:00. [2026-03-16 12:47:15,225] WARNING in apscheduler: Added job_instance: { "id": "48", "kwargs": { "task_id": 48 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_48", "next_run_time": "datetime.datetime(2026, 3, 16, 20, 0, tzinfo=)", "trigger": "" } [2026-03-16 12:48:59,813] WARNING in apscheduler: Add task #49 (task_49) successfully, next run at 2026-03-16 15:00:00+00:00. [2026-03-16 12:48:59,813] WARNING in apscheduler: Added job_instance: { "id": "49", "kwargs": { "task_id": 49 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_49", "next_run_time": "datetime.datetime(2026, 3, 16, 15, 0, tzinfo=)", "trigger": "" } [2026-03-16 12:51:51,915] WARNING in apscheduler: Add task #50 (task_50) successfully, next run at 2026-03-16 15:00:00+00:00. [2026-03-16 12:51:51,915] WARNING in apscheduler: Added job_instance: { "id": "50", "kwargs": { "task_id": 50 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_50", "next_run_time": "datetime.datetime(2026, 3, 16, 15, 0, tzinfo=)", "trigger": "" } [2026-03-16 16:30:00,443] WARNING in apscheduler: Fail to execute task #33 (None) on node 5, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ecarstrade.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-4:6800/schedule.json'} [2026-03-16 16:30:03,460] ERROR in apscheduler: Fail to execute task #33 (None) on node 5, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ecarstrade.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-4:6800/schedule.json'} [2026-03-17 07:00:01,933] WARNING in apscheduler: Fail to execute task #27 (batch0) on node 5, would retry later: Request got {'status_code': 500, 'status': 'error', 'message': '500 Internal Server Error: The server encountered an internal error and was unable to complete your request. Either the server is overloaded or there is an error in the application.'} [2026-03-17 07:00:04,966] ERROR in apscheduler: Fail to execute task #27 (batch0) on node 5, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'status_code': 500, 'status': 'error', 'message': '500 Internal Server Error: The server encountered an internal error and was unable to complete your request. Either the server is overloaded or there is an error in the application.'} [2026-03-17 10:30:00,295] WARNING in apscheduler: Fail to execute task #17 (batch0) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.de' has reached the limit 2.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-17 10:30:03,311] ERROR in apscheduler: Fail to execute task #17 (batch0) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.de' has reached the limit 2.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-19 00:00:00,048] WARNING in apscheduler: Fail to execute task #42 (None) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ecarstrade.de' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-19 00:00:03,065] ERROR in apscheduler: Fail to execute task #42 (None) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ecarstrade.de' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-19 06:59:47,415] WARNING in apscheduler: Add task #51 (task_51) successfully, next run at 2026-03-19 08:00:00+00:00. [2026-03-19 06:59:47,415] WARNING in apscheduler: Added job_instance: { "id": "51", "kwargs": { "task_id": 51 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_51", "next_run_time": "datetime.datetime(2026, 3, 19, 8, 0, tzinfo=)", "trigger": "" } [2026-03-19 11:00:01,033] WARNING in apscheduler: Fail to execute task #51 (None) on node 1, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-0:6800/schedule.json'} [2026-03-19 11:00:04,054] ERROR in apscheduler: Fail to execute task #51 (None) on node 1, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-0:6800/schedule.json'} [2026-03-19 16:30:00,235] WARNING in apscheduler: Fail to execute task #33 (None) on node 5, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ecarstrade.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-4:6800/schedule.json'} [2026-03-19 16:30:03,260] ERROR in apscheduler: Fail to execute task #33 (None) on node 5, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'ecarstrade.be' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-4:6800/schedule.json'} [2026-03-20 07:22:34,847] WARNING in apscheduler: Update task #23 (batch1) successfully, next run at 2026-03-20 09:05:00+00:00. [2026-03-20 07:22:34,847] WARNING in apscheduler: Updated job_instance: { "id": "23", "kwargs": { "task_id": 23 }, "max_instances": 2, "misfire_grace_time": 600, "name": "batch1", "next_run_time": "datetime.datetime(2026, 3, 20, 9, 5, tzinfo=)", "trigger": "" } [2026-03-20 07:23:04,194] WARNING in apscheduler: Update task #24 (batch0) successfully, next run at 2026-03-20 09:00:00+00:00. [2026-03-20 07:23:04,194] WARNING in apscheduler: Updated job_instance: { "id": "24", "kwargs": { "task_id": 24 }, "max_instances": 2, "misfire_grace_time": 600, "name": "batch0", "next_run_time": "datetime.datetime(2026, 3, 20, 9, 0, tzinfo=)", "trigger": "" } [2026-03-20 10:35:00,049] WARNING in apscheduler: Fail to execute task #18 (batch1) on node 3, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.de' has reached the limit 2.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-20 10:35:03,242] ERROR in apscheduler: Fail to execute task #18 (batch1) on node 3, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'auto1.de' has reached the limit 2.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-2:6800/schedule.json'} [2026-03-30 11:00:01,048] WARNING in apscheduler: Fail to execute task #51 (None) on node 1, would retry later: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-0:6800/schedule.json'} [2026-03-30 11:00:04,154] ERROR in apscheduler: Fail to execute task #51 (None) on node 1, no more retries: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/scrapydweb/views/operations/execute_task.py", line 89, in schedule_task assert js['status_code'] == 200 and js['status'] == 'ok', "Request got %s" % js AssertionError: Request got {'auth': None, 'message': "The number of scheduled or running tasks of project 'sourcing_v2' and spider 'bca.uk' has reached the limit 1.", 'status': 'error', 'status_code': -1, 'url': 'http://scrapyd-0:6800/schedule.json'}