ONNXRuntime下载

        下载地址：Releases · microsoft/onnxruntime (github)

        在下载地址找到对应版本，历史版本在Assets点开折叠后可以看到，可下载内容如下，如果需要支持GPU需要下载对应版本。

         也可以通过指定版本的地址直接定位到想要的版本，例如1.8.0

https://github/microsoft/onnxruntime/releases/tag/v1.8.0

GPU环境准备

        因为onnxruntime官方不支持windows编译（编译需要的Nvidia NCCL不支持widows），所以使用release包时需要使用比较严格对应的CUDA和cudnn，参考安装说明。但实际测试发现也并非严格对应，比如1.10.0可以用1.8.0的环境，但不能用1.6.0的环境。

Please reference table below for official GPU packages dependencies for the ONNX Runtime inferencing package. Note that ONNX Runtime Training is aligned with PyTorch CUDA versions; refer to the Training tab on https://onnxruntime.ai/ for supported versions.

Note: Because of CUDA Minor Version Compatibility, Onnx Runtime built with CUDA 11.4 should be compatible with any CUDA 11.x version. Please reference Nvidia CUDA Minor Version Compatibility.

ONNX Runtime	CUDA	cuDNN	Notes
1.10	11.4	8.2.4 (Linux) 8.2.2.26 (Windows)	libcudart 11.4.43 libcufft 10.5.2.100 libcurand 10.2.5.120 libcublasLt 11.6.1.51 libcublas 11.6.1.51 libcudnn 8.2.4
1.9	11.4	8.2.4 (Linux) 8.2.2.26 (Windows)	libcudart 11.4.43 libcufft 10.5.2.100 libcurand 10.2.5.120 libcublasLt 11.6.1.51 libcublas 11.6.1.51 libcudnn 8.2.4
1.8	11.0.3	8.0.4 (Linux) 8.0.2.39 (Windows)	libcudart 11.0.221 libcufft 10.2.1.245 libcurand 10.2.1.245 libcublasLt 11.2.0.252 libcublas 11.2.0.252 libcudnn 8.0.4
1.7	11.0.3	8.0.4 (Linux) 8.0.2.39 (Windows)	libcudart 11.0.221 libcufft 10.2.1.245 libcurand 10.2.1.245 libcublasLt 11.2.0.252 libcublas 11.2.0.252 libcudnn 8.0.4
1.5-1.6	10.2	8.0.3	CUDA 11 can be built from source
1.2-1.4	10.1	7.6.5	Requires cublas10-10.2.1.243; cublas 10.1.x will not work
1.0-1.1	10.0	7.6.4	CUDA versions from 9.1 up to 10.1, and cuDNN versions from 7.1 up to 7.4 should also work with Visual Studio 2017

For older versions, please reference the readme and build pages on the release branch.

        以CUDA11.0.3和cudnn8.0.2.39下载环境安装，CUDA只安装runtime和development，cudnn解压放到cuda安装目录即可。

VS开发配置

工程属性

C/C++ -> Additional Include Directories添加：

D:\libs\onnxruntime-win-x64-gpu-1.10.0\include

Linker -> Additional Library Directories添加：

D:\libs\onnxruntime-win-x64-gpu-1.10.0\lib

Linker -> Input -> Additional

onnxruntime.lib

使用时

#include <onnxruntime_cxx_api.h>

如果cuda/cudnn环境与onnxruntime不适配，在session.run()时会报错，例如：

Unhandled exception at 0x00007FF84C9D313C (cudnn64_8.dll) in onnx.exe: Fatal program exit requested.