Direct Access Transport Libraries - v1 (8/9/10) and v2 (2/14/2011)

User space libraries/utilities for Direct Access Transport (DAT). DAT is a transport-independent, platform-independent Application Programming Interface that supports RDMA (remote direct memory access) devices. Directory includes packages that include libdat, libdapl, and utilities for both DAT API Spec Version 1.2 and 2.0.

Latest Packages (see ChangeLog for recent changes):

• md5sum: ef98486354feb7ea930f3cd698a310fd compat-dapl-1.2.19.tar.gz
• md5sum: 0a56cb34462762f0073d732cfe2fb06e dapl-2.0.32.tar.gz

For 1.2 and 2.0 support on same system, including development, install RPM packages as follow:

• dapl-2.0.32-1
• dapl-utils-2.0.32-1
• dapl-devel-2.0.32-1
• dapl-debuginfo-2.0.32-1
• compat-dapl-1.2.19-1
• compat-dapl-devel-1.2.19-1

Summary of v2.0 and v1.2 changes:

• Release 2.0.32 fixes (OFED 1.5.3 GA):
• cma: reduce output log level in disconnect from WARN to CM_WARN
• ucm: delay freeing of active side UD cm object in case RTU is dropped
• ucm: cm object needs to be on work queue before req sent on wire
• ucm, scm: remove use of usec_sleep delays and use events for disc and destroy
• common: reduce default max inline data size because of performance anomaly
• common: dapls_evd_dto_wait() dbg message should print status and not errno
• ucm, scm: exchange max_qp_rd_atom and limit outstanding requests
• scm: retry socket connect on ECONNREFUSED under heavy load
• common: qp modify RTR using wrong ep attribute parameter for dest_rd_atomic
• Release 2.0.31 fixes (OFED 1.5.3 RC1):
• common: clean up build warning for unused variable event_ptr
• scm, ucm: set RAI_NOROUTE flag with rdma_getaddrinfo() call to avoid blocking.
• cma: definition for dapl_sp_remove_ep() is missing in cm.c
• libdat: static provider entries created for local SR database not freed
• libdat: memory leak in static registration during parsing
• common: increase default IB inline send threshold to 400
• common cq: a mixup of errno and the -1 return from poll in dapls_wait_comp_channel
• ucm: release UD cm objects after AH is exchanged to avoid duplicate request drops
• ucm: decrease timeout retry count for disconnect requests
• ucm: hold lock when sending cm_msgs to sync timer start with packet send
• ucm: add debugging to include process id for better scale up debug aids
• cma: disconnect can block for excessive times waiting for rdma_cm DREP timeout
• ucm: configure the recv channel FD to non-blocking
• windows: Missing librdmacm include path for build
• debug build: only timestamp if sending to stdout to avoid performance hit
• common: print out errors on free build and not just debug builds
• cma: fix debug build issue
• scm, ucm: MPI spawn test on oversubcribed server taking excessive time to complete
• common: add high resolution time stamps and thread id to sdtout debug logs
• common: modify debug in dat_evd_dequeue to reduce noise, only output on non-empty
• cma: rdma_destroy_id called twice during device open bind error
• common: dat_evd_dequeue (poll_cq) fails with invalid parameter after EP (qp) free
• ucm: allow configuration of CM burst (signal) threshold on posting
• cma: fix debug build
• windows: debug version of windows does not build.
• Allow DAPL out of band connection models to use ibacm to obtain path record data.
• ucm: add missing map file for UCM provider
• ibal: delay QP transition during disconnect phase
• Revert "ibal: delay QP transition during disconnect phase"
• ibal: delay QP transition during disconnect phase
• common: restructure EVD processing to handle EP destruction phase
• ibal: sync QP destruction and device close
• ucm: remove unnecessary debug warning in async callback
• Release 1.2.19 fixes (OFED 1.5.2 GA):
• common, cma: disconnect and cleanup CR linkings after DTO error on EP
• Release 1.2.18 fixes (OFED 1.5.2 RC3):
• common: race conditions with DTO error, disconnect and dapl_reset_ep
• common: add new dapl_os_sleep_usec() function
• configure: need a false conditional for verbs attr.link_layer member check
• Release 1.2.17 fixes (OFED 1.5.2 RC2):
• config: add conditional check for new verbs port_attr.link_layer
• cma, scm: new provider entries for Mellanox RDMA over Ethernet device for uDAPL v1.2
• cma: memory leak of verbs CQ and completion channels created during dat_ia_open
• cma: memory leak of FD's (pipe) created during dat_evd_create

• For more details see the following:

  • documentation/uDAPL_release_notes.txt for latest OFED release notes
  • documentation/uDAPL_v20.pdf for v2 API specification
  • documentation/transition_to_dat20_120406.pdf for details on porting to 2.0
  • documentation/DAT_IB_Extensions.pdf for IB extension details.
  • documentation/DAT_IW_Extensions.pdf for iWARP extension details.
  • documentation/uDAPL_ofed_testing_bkm.pdf for latest uDAPL OFED BKM, updated 8-22-2008

  uDAT/uDAPL source git tree is located at git://git.openfabrics.org/~ardavis/scm/dapl.git