Apache Spark

Open source

Unified engine for large-scale data processing supporting batch and streaming workloads.

by Apache Software FoundationOfficial site ↗Source code ↗

Pricing: free
License: open-source
Open source: Yes

Editorial review

Apache Spark has not yet been editorially reviewed. User reviews and published field data below are unaffected — we say so rather than implying an editorial verdict.

Facts & attributes

Every value carries its evidence state. “—” means unknown — never a silent default (P-02).

Identity · Taxonomy

Documentation(HTTPS URL): https://spark.apache.org/docs/latest/Verified
Tags(open-source;cloud-native): big-data, data-engineering, sql, machine-learning, streamingVerification pending

Platform · Deployment

Delivery model(SaaS;self-hosted;desktop;mobile;embedded;managed-cloud;appliance): self-hostedVerification pending

Pricing · Licensing

License model(proprietary;open-source;source-available;dual-license): open-sourceVerification pending
Pricing model(free;subscription;usage;seat;asset;transaction;revenue-share;perpetual;custom): freeVerification pending
Source repository(HTTPS URL): https://github.com/apache/sparkVerified
SPDX license IDs(Apache-2.0;MIT): Apache-2.0Verified

Features · Product · Fit

Core capabilities(authoring;automation;analytics): Batch and streaming data processing, Fast distributed ANSI SQL analytics, Machine learning training and inference (MLlib), Exploratory data science on petabyte-scale data, Multi-language engine: Python, SQL, Scala, Java, RVerification pending

Api · Integrations · Ecosystem

API available(true/false): trueVerification pending

Audience · Use · Case

Best for(Neutral editorial summary): Large-scale data engineering, SQL analytics, and machine learning on single nodes or clustersVerification pending
Company-size fit(individual;SMB;mid-market;enterprise): SMB, enterpriseVerification pending
Skill level(beginner;intermediate;advanced;specialist): advancedVerified

Lifecycle · Versioning

Current version(1.12.3): 4.3.0Verified
Maintenance status(active;maintenance;deprecated;EOL;archived): activeVerification pending

Vendor · Maintainer

Vendor type(commercial;foundation;community;government;consortium;individual): foundationVerified

Also categorized in

Stream Processing Frameworks

User reviews

Review policy

No published reviews yet.