Data Mechanics
Data Mechanics, acquired by NetApp in 2021, is a B2B company based in Paris that offers a managed Spark-on-Kubernetes platform and a free, hosted Spark UI alternative named Delight.
Company Overview
Data Mechanics, located in Paris, Île-de-France, France, operates within the B2B infrastructure industry. The company was launched in May 2019 and has a team size of 25. Data Mechanics participated in the S19 batch of Y Combinator and was acquired by NetApp in 2021, subsequently integrated into the Spot.io product portfolio.
Products and Services
Data Mechanics offers a managed Spark-on-Kubernetes platform named Ocean for Apache Spark, designed to enhance the performance and efficiency of big data processing. Additionally, the company provides Data Mechanics Delight, a free, hosted Spark UI alternative that introduces new metrics and visualizations. Delight includes an open-source agent that runs inside Spark applications and streams metrics to a backend. The platform supports various data inputs and outputs and can operate on Kubernetes, YARN, or standalone.
Y Combinator and Acquisition
Data Mechanics was part of Y Combinator's S19 batch, an accelerator that supports early-stage startups. In 2021, Data Mechanics was acquired by NetApp, a data management and cloud services company. Following the acquisition, Data Mechanics was integrated into NetApp’s Spot.io product portfolio, aiming to leverage combined technologies to enhance big data processing and infrastructure solutions.
Apache Spark Ecosystem
Apache Spark, the core technology behind Data Mechanics' offerings, is a widely adopted open-source distributed computing engine known for its speed in processing big data. Spark handles both batch and streaming workloads efficiently and is utilized by thousands of organizations globally. The Spark ecosystem is robust, supporting multiple programming languages and providing native libraries for streaming, machine learning, graph computing, and SQL, making it a versatile tool for data processing needs.