cuda: snake 활성화 연산자 병합 (곱셈, 사인, 제곱, 곱셈, 덧셈) (#22667)
cuda: snake 활성화 연산자 병합 (곱셈, 사인, 제곱, 곱셈, 덧셈)
Add ggml_cuda_op_snake_fused 를 추가하여 F32 / F16 / BF16 템플릿 제공.
The matcher 는 audio decoder 에서 방출하는 naive 5 op 분해 (BigVGAN, Vocos) 를 인식하고 snake 활성화 y = x + sin(a*x)^2 * inv_b 를 단일 elementwise kernel 로 재작성함.
Add test_snake_fuse 를 추가하여 F32 / F16 / BF16 에서 CPU naive 와 CUDA fused 를 비교함.
cuda: @am17an 의 리뷰 피드백 반영
Use ggml_cuda_cast 를 사용하여 F32/F16/BF16 변환 및 kernel_snake 를 snake_kernel 로 리네임하여 upstream conventions 과 일치시킴.
cuda: snake fusion fastdiv on T_len, Suggested-by: @am17an
Update tests/test-backend-ops.cpp
Co-authored-by: Aman Gupta amangupta052@gmail.com
cuda: snake fusion check add->type matches x->type
Address review feedback from @am17an
cuda: snake fusion check add->type matches x->type
Moved for readability (equivalent)
Address review feedback from @am17an
Co-authored-by: Aman Gupta amangupta052@gmail.com
macOS/iOS:
macOS Apple Silicon (arm64)
macOS Apple Silicon (arm64, KleidiAI enabled)
macOS Intel (x64)
iOS XCFramework
Linux:
Ubuntu x64 (CPU)
Ubuntu arm64 (CPU)
Ubuntu s390x (CPU)
Ubuntu x64 (Vulkan)
Ubuntu arm64 (Vulkan)
Ubuntu x64 (ROCm 7.2)
Ubuntu x64 (OpenVINO)
Ubuntu x64 (SYCL FP32)
Ubuntu x64 (SYCL FP16)
Android:
Android arm64 (CPU)
Windows:
Windows x64 (CPU)
Windows arm64 (CPU)
Windows x64 (CUDA 12) - CUDA 12.4 DLLs
Windows x64 (CUDA 13) - CUDA 13.1 DLLs
Windows x64 (Vulkan)
Windows x64 (SYCL)
Windows x64 (HIP)
openEuler:
openEuler x86 (310p)
openEuler x86 (910b, ACL Graph)
openEuler aarch64 (310p)
openEuler aarch64 (910b, ACL Graph)