Built something similar, getting 42 million/sec on an 3070 and 170 M on an H200 https://github.com/rossbates/rummage/blob/main/docs/PERFORMANCE.md