Alexei Starovoitov d114dde245
bpf: Change bpf_mem_cache draining process. ...
The next patch will introduce cross-cpu llist access and existing
irq_work_sync() + drain_mem_cache() + rcu_barrier_tasks_trace() mechanism will
not be enough, since irq_work_sync() + drain_mem_cache() on cpu A won't
guarantee that llist on cpu A are empty. The free_bulk() on cpu B might add
objects back to llist of cpu A. Add 'bool draining' flag.
The modified sequence looks like:
for_each_cpu:
WRITE_ONCE(c->draining, true); // do_call_rcu_ttrace() won't be doing call_rcu() any more
irq_work_sync(); // wait for irq_work callback (free_bulk) to finish
drain_mem_cache(); // free all objects
rcu_barrier_tasks_trace(); // wait for RCU callbacks to execute
Signed-off-by: Alexei Starovoitov <ast@kernel.org >
Signed-off-by: Daniel Borkmann <daniel@iogearbox.net >
Acked-by: Hou Tao <houtao1@huawei.com >
Link: https://lore.kernel.org/bpf/20230706033447.54696-8-alexei.starovoitov@gmail.com
2023-07-12 23:45:22 +02:00
2023-07-12 23:45:22 +02:00
2023-06-28 10:28:11 -07:00
2023-04-27 12:07:50 -07:00
2022-12-02 11:25:00 +01:00
2023-06-19 16:19:23 -07:00
2023-04-16 14:23:07 +02:00
2023-06-28 10:28:11 -07:00
2023-01-01 11:15:05 -08:00
2022-12-21 14:31:52 -08:00
2023-06-26 11:05:49 +02:00
2023-04-27 19:42:02 -07:00
2023-04-28 14:53:30 -07:00
2023-06-28 10:59:38 -07:00
2023-06-28 15:51:08 -07:00
2023-06-28 10:28:11 -07:00
2023-06-05 21:11:03 +02:00
2023-06-07 13:44:06 -07:00
2023-06-27 16:54:21 -07:00
2023-06-27 21:24:18 -07:00
2023-07-11 20:07:51 -07:00
2022-11-30 16:13:18 -08:00
2022-08-22 18:50:06 -04:00
2022-04-25 14:37:28 +02:00
2022-09-01 17:39:30 -04:00
2022-08-29 19:47:03 -04:00
2023-05-17 11:34:55 -04:00
2023-03-01 10:01:22 -08:00
2022-09-26 19:46:09 -07:00
2023-05-22 14:30:52 -04:00
2022-09-26 10:13:13 -07:00
2023-03-14 19:32:38 -07:00
2023-06-05 09:57:20 +02:00
2023-01-13 11:48:15 +01:00
2023-05-23 18:06:40 +02:00
2023-04-05 19:42:46 -07:00
2022-11-01 10:04:52 -07:00
2023-04-18 16:39:34 -07:00
2023-06-01 17:15:33 -04:00
2022-07-05 13:32:59 -07:00
2023-02-08 13:36:22 +01:00
2023-06-28 10:59:38 -07:00
2022-09-07 21:53:50 +02:00
2023-01-22 23:43:34 +09:00
2022-07-15 18:21:49 +00:00
2023-04-08 13:45:37 -07:00
2023-03-24 11:01:29 +01:00
2022-12-01 15:53:05 -08:00
2022-11-12 18:47:36 -08:00
2023-03-19 13:27:19 -07:00
2022-11-15 00:42:02 -08:00
2023-06-28 15:51:08 -07:00
2023-06-09 17:44:17 -07:00
2023-06-09 17:44:24 -07:00
2023-06-28 10:59:38 -07:00
2022-09-11 21:55:06 -07:00
2023-02-02 22:50:05 -08:00
2023-03-24 20:10:59 -07:00
2023-02-21 08:49:16 +09:00
2023-06-08 12:27:20 -07:00
2023-03-24 17:09:14 +01:00
2023-06-28 10:59:38 -07:00
2022-09-11 21:55:12 -07:00
2023-06-28 15:51:08 -07:00
2023-04-08 13:45:38 -07:00
2023-04-20 22:55:35 -04:00
2023-03-14 17:06:44 +08:00
2023-06-09 17:44:15 -07:00
2023-06-14 12:27:38 -07:00
2023-05-02 19:23:29 -07:00
2023-06-19 16:19:28 -07:00
2023-04-03 11:16:56 +02:00
2022-09-11 21:55:12 -07:00
2023-04-16 14:23:07 +02:00
2022-10-04 15:59:36 +02:00
2023-05-02 17:23:27 -07:00
2023-02-17 14:58:01 -08:00
2022-12-27 12:52:12 +01:00
2022-11-09 18:06:35 +00:00
2023-04-13 11:49:20 -07:00
2023-06-28 16:05:21 -07:00
2023-06-16 22:08:09 +02:00
2023-05-15 13:45:00 +02:00
2023-05-09 21:50:27 +02:00
2023-04-20 11:36:35 +02:00
2022-10-17 16:41:16 +02:00
2022-05-24 11:11:13 -07:00
2023-06-09 16:25:16 -07:00
2023-05-02 17:21:49 -07:00
2022-09-08 16:56:45 -07:00
2023-06-28 16:05:21 -07:00
2022-09-11 21:55:10 -07:00
2022-08-29 12:47:15 +01:00
2023-01-05 12:10:35 -08:00
2023-02-18 14:34:36 -05:00
2022-04-29 14:38:03 -07:00
2022-05-18 18:24:57 -05:00
2023-06-08 15:41:34 -07:00
2023-02-02 22:50:04 -08:00
2022-11-30 20:16:49 -04:00
2022-05-19 23:25:47 -04:00
2023-04-13 11:49:35 -07:00
2023-06-08 15:43:09 -04:00
2023-06-06 10:47:04 +02:00
2023-06-19 16:25:28 -07:00
2023-06-09 17:44:21 -07:00
2023-06-19 16:25:29 -07:00
2023-05-17 17:02:08 -10:00
2023-06-27 16:32:52 -07:00
d114dde245