[WIP] Add QNN EP HTP shared memory allocator#23136

Draft

edgchen1 wants to merge 35 commits intomainfrom edgchen1/qnn_ep_rpcmem

+1,112-180

Commits on Nov 5, 2024

save work
edgchen1
committed

Commits on Nov 9, 2024

save work
edgchen1
committed

Commits on Nov 11, 2024

add logging for setting QNN tensor memory, update comment
edgchen1
committed
add option to enable HTP shared memory allocator to onnxruntime_perf_test
edgchen1
committed

Commits on Nov 12, 2024

hack - try to cache mem handles in QnnModel
edgchen1
committed

Commits on Nov 14, 2024

Commits on Nov 15, 2024

Commits on Nov 19, 2024

Merge remote-tracking branch 'origin/main' into edgchen1/qnn_ep_rpcmem
edgchen1
committed

Commits on Nov 27, 2024

rename to RpcMemAllocator to HtpSharedMemoryAllocator
edgchen1
committed

Commits on Dec 2, 2024

Merge remote-tracking branch 'origin/main' into edgchen1/qnn_ep_rpcmem
edgchen1
committed

Commits on Dec 3, 2024

remove onnx protobuf dependency from allocator.h, add shared provider declarations and definitions for IAllocator::TensorAlloc().
edgchen1
committed

Commits on Dec 5, 2024

Commits on Dec 11, 2024

remove shared mem handles from shared context
edgchen1
committed

Commits on Dec 16, 2024

remove allocation clean up callback removal, use weak_ptrs in allocation clean up callback
edgchen1
committed

Commits on Dec 18, 2024

Commits on Dec 19, 2024