prov/efa: Respect FI_MR_LOCAL in transport path

Currently, efa provider tries to register user buffer in transport in multiple places without checking whether application sets FI_MR_LOCAL, which is not complied with Libfabric standard. Add warning when application sets FI_MR_LOCAL but does not provide a valid desc parameter into applicable data transfer operations. Signed-off-by: Jessie Yang <[email protected]>
jiaxiyan · Aug 28, 2024 · 8cdb10f · 8cdb10f
1 parent fe1bf36
commit 8cdb10f
Showing 1 changed file with 7 additions and 0 deletions.
diff --git a/prov/efa/src/rdm/efa_rdm_ope.c b/prov/efa/src/rdm/efa_rdm_ope.c
@@ -268,6 +268,13 @@ void efa_rdm_ope_try_fill_desc(struct efa_rdm_ope *ope, int mr_iov_start, uint64
 		if (ope->desc[i])
 			continue;
 
+		if (ope->ep->base_ep.domain->mr_local) {
+			EFA_WARN(FI_LOG_EP_CTRL,
+				 "FI_MR_LOCAL is set, but no valid desc is provided."
+				 "buf: %p len: %ld access: %lx\n",
+				 ope->iov[i].iov_base, ope->iov[i].iov_len, access);
+		}
+
 		err = fi_mr_regv(
 			&efa_rdm_ep_domain(ope->ep)->util_domain.domain_fid,
 			ope->iov + i, 1, access, 0, 0, 0, &ope->mr[i],