This content originally appeared on DEV Community and was authored by Rajnish
Databricks
it is a unified, open analytics platform for building, deploying, sharing and maintaining data, analytics, and AI solutions at scale.
Clusters
it’s a collection of VM (Virtual Machines) instances.
over which computational workloads are distributed across workers
There are two types
| All-Purpose Clusters | Job Clusters |
|---|---|
| Analyse data collectively using interactive Notebooks | Run automated jobs |
| Create cluster from the workspace or API | The Databricks job scheduler creates job clusters when running jobs |
| Configuration information is retained for upto 70 clusters for upto 30 days | Configuration information is retained for upto 30 most recently terminated cluster |
This content originally appeared on DEV Community and was authored by Rajnish
Rajnish | Sciencx (2024-11-11T17:29:00+00:00) Databricks introduction. Retrieved from https://www.scien.cx/2024/11/11/databricks-introduction/
Please log in to upload a file.
There are no updates yet.
Click the Upload button above to add an update.

