Data Processing Engine

Compression
The Cloud-Edge Sort compression algorithm, using proprietary techniques compresses data with ratios between 4:1 and 20:1. This enables improved overall machine workload output and provides massive storage savings. Another significant feature is the ability for the data to be analyzed at a detailed level in its compressed state, without losing performance.

See benchmarks

Scanning
The DPE uses RAID technology to efficiently move and filter data in parallel, to and from disk I/O subsystems. The scanning algorithms work closely with other low-level algorithms to keep pipelines and caches loaded efficiently.

See benchmarks

Sorting
The unique Sort heuristic algorithm is a cornerstone of the Cloud-Edge Sort system achieving substantial performance gains. It has benchmarked favorably against both stand-alone Sort Software Solutions and exotic sort algorithms from academia.

See benchmarks

Indexing
The dynamic Cloud-Edge Sort indexing algorithm utilizes the parallel processing of scanning and sorting to create indices quickly. This allows for high performance in database queries. Multiple indices are created simultaneously within a single data scan, allowing for rapid data update processes. The index structure is dynamic in that the raw data used by the indices are heuristically examined to create and maintain optimal structure. This index structure is modified automatically to achieve and maintain optimal memory usage and one-disk-access performance. All this data is accessed in the compressed state and hundreds of indices can be kept open simultaneously.
See benchmarks