Skip to content

feat(gpu-remoting): add server-side CUDA callback handlers, storage data#52

Merged
yumemiso merged 1 commit into
mainfrom
dev_madd
Jul 7, 2026
Merged

feat(gpu-remoting): add server-side CUDA callback handlers, storage data#52
yumemiso merged 1 commit into
mainfrom
dev_madd

Conversation

@madd2014

@madd2014 madd2014 commented Jul 6, 2026

Copy link
Copy Markdown
Contributor

pipeline, and validation test samples
Add three core modules for the GPU virtualization remoting service:

  • server: Implement RPC-based server endpoint with ~150 CUDA/cuBLAS/cuDNN/NCCL API callback handlers, virtual-to-real address mapping, checkpoint backup/recovery, and multi-client scheduling support

    - storage: Build the remote data feeding pipeline with
    

    shared-memory ring queue
    for zero-copy batch transfer to GPU, PyTorch
    DataLoader-compatible transparent API
    (FlexGVirtDataLoader), and 3D medical imaging preprocessing
    utilities

      - sample: Add comprehensive CUDA validation test suite
        covering memory management,
          kernel launch, stream/event/device APIs, CUDA Graph,
      multi-threading, cuBLAS, cuBLASLt, cuDNN, NCCL multi-node communication, and performance benchmarks
    

pipeline, and validation test samples
Add three core modules for the GPU virtualization remoting service:
- server: Implement RPC-based server endpoint with ~150
  CUDA/cuBLAS/cuDNN/NCCL
    API callback handlers, virtual-to-real address mapping, checkpoint
    backup/recovery,
      and multi-client scheduling support

      - storage: Build the remote data feeding pipeline with
	shared-memory ring queue
	  for zero-copy batch transfer to GPU, PyTorch
	  DataLoader-compatible transparent API
	    (FlexGVirtDataLoader), and 3D medical imaging preprocessing
	    utilities

	    - sample: Add comprehensive CUDA validation test suite
	      covering memory management,
	        kernel launch, stream/event/device APIs, CUDA Graph,
		multi-threading, cuBLAS,
		  cuBLASLt, cuDNN, NCCL multi-node communication, and
		  performance benchmarks
@yumemiso yumemiso merged commit 4f0f8fb into main Jul 7, 2026
1 check failed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants