Modern Analytics DatabaseArchitected for Performance at Scale
What's under the hood?
Kinetica has a distributed architecture that has been designed for data processing at scale. A standard cluster consists of identical nodes run on commodity hardware. A single node is chosen to be the head aggregation node.
A cluster can be scaled up at any time to increase storage capacity and processing power, with near-linear scale processing improvements for most operations. Sharding of data can be done automatically, or specified and optimized by the user.
Distributed Ingest & Query
Kinetica uses a shared-nothing data distribution across worker nodes. The head node receives a query and breaks it down into small tasks that can be spread across worker nodes. To avoid bottlenecks at the head node, ingestion can also be organized in parallel by all the worker nodes. Kinetica is able to distribute data client-side before sending it to designated worker nodes. This streamlines communication and processing time.
For the client application, there is no need to be aware of how many nodes are in the cluster, where they are, or how the data is distributed across them!
Columnar data structures lend themselves to low-latency reads of data. But from a user's perspective, Kinetica behaves very similarly to a standard relational database – with tables of rows and columns and it can be queries with SQL or through APIs. Available column types include the standard base types (int, long, float, double, string, & bytes), as well as numerous sub-types supporting date/time, geospatial, and other data forms.
Vectorization is Kinetica’s secret sauce and the key feature that underpins its blazing fast performance.
Advanced vectorized kernels are optimized to use vectorized CPUs and GPUs for faster performance. The query engine automatically assigns tasks to the processor where they will be most performant. Aggregations, filters, window functions, joins and geospatial rendering are some of the capabilities that see performance improvements.
Memory-First, Tiered Storage
Tiered storage makes it possible to optimize where data lives for performance and cost. Recent data (such as all data where the timestamp is within the last 2 weeks) can be held in-memory, while older data can be moved to disk, or even to external storage services.
Kinetica operates on an entire data corpus by intelligently managing data across GPU memory, system memory, SIMD, disk / SSD, HDFS, and cloud storage like S3 for optimal performance. Kinetica can also query and process data stored in data lakes, joining it with data managed by Kinetica in highly parallelized queries.
Performant Key-Value Lookup
Kinetica is able to generate distributed key-value lookups, from columnar data, for high-performance and concurrency. Sharding logic is embedded directly within client APIs enabling linear scale-out as clients can lookup data directly from the node where the data lives.
Kinetica can be deployed and scaled in a cloud environment. KAgent may be used to automatically provision as many instances as desired and link several clusters of instances together for high availability (if necessary). KAgent currently supports provisioning to the three major cloud infrastructure vendors:
Interact with Kinetica through SQL, APIs and Connectors
Write Queries in SQL
Use with Popular BI Tools
Connect popular BI tools such as Tableau, Spotfire and PowerBI to Kinetica for real-time analytics using the ODBC/JDBC connector. Or provides streams to systems outside of Kinetica with the Kafka Connector.
REST & Native API's
API Documentation »
Evolved to Meet the Demands of the Modern Enterprise
Work with petabytes of data at speed with Kinetica's memory-first, fully distributed architecture. Kinetica prioritizes and manages data across VRAM, RAM, disk, and cold storage and can create external tables for working with data in HDFS, S3 and Azure.
Kinetica provides advanced data access controls that let you define dynamic obfuscation, redaction, and access rules down to the column level. Kinetica works out of the box with industry standard external authentication and identity systems like LDAP, Active Directory and Kerberos.
Eliminate single points of failure and recover gracefully. Kinetica offers node and process failover for in-cluster resiliency, and multiple clusters may be grouped in a ring resiliency to spread data and ensure eventual consistency.
Kinetica's administration, installation, and configuration management tools give users an intuitive way to provision cloud hardware, configure cluster security, add/remove nodes, data backup and monitor cluster health.