WiscSort: External Sorting For Byte-Addressable Storage

AI Systems and Hardware EDIO Other AI Sys & HW
我们提出了WiscSort,这是一种针对现有和未来的字节可寻址存储(BAS)设备的高性能并发排序新方法。WiscSort通过在排序过程中分割键和值来利用随机读取,同时通过线程池调度进行干扰感知调度,避免I/O带宽降低。我们引入了BRAID模型,该模型包括BAS设备的独特特征。许多最先进的排序系统不符合BRAID模型,提供次优性能,而WiscSort展示了符合BRAID的有效性。我们展示了WiscSort在标准排序基准测试中比竞争方法快2-7倍。我们评估了键值分离对不同键值大小的有效性,并将我们的并发优化与各种其他并发模型进行了比较。最后,我们模拟了通用BAS设备,并展示了我们的技术如何在各种硬件属性组合下表现良好。
We present WiscSort, a new approach to high-performance concurrent sorting for existing and future byte-addressable storage (BAS) devices. WiscSort carefully reduces writes, exploits random reads by splitting keys and values during sorting, and performs interference-aware scheduling with thread pool sizing to avoid I/O bandwidth degradation. We introduce the BRAID model which encompasses the unique characteristics of BAS devices. Many state-of-the-art sorting systems do not comply with the BRAID model and deliver sub-optimal performance, whereas WiscSort demonstrates the effectiveness of complying with BRAID. We show that WiscSort is 2-7x faster than competing approaches on a standard sort benchmark. We evaluate the effectiveness of key-value separation on different key-value sizes and compare our concurrency optimizations with various other concurrency models. Finally, we emulate generic BAS devices and show how our techniques perform well with various combinations of hardware properties.
许愿