Databricks Associate Data Engineer

  • Databricks Workspace Administration: Workspace creation, cluster scaling settings (Standard, High Concurrency, Single Node), PAT authentication, and user/group access control.

  • Core Notebook Functionalities: Parameter management, widgets, importing/exporting notebooks, and using DBUtils file commands.

  • Pyspark Dataframe API: Distributed RDD/Dataset transformations, dataframe methods (lit, cast, withColumn), and SparkSQL processing.

  • Databricks Delta Lakes: ACID compliance validation, time-travel history queries, and building internal/external managed tables.

Databricks