Databricks in Data & Analytics

Add AI tasks like classification, extraction, and summarization directly to SQL and PySpark pipelines.

Build real-time data ingestion clients that write directly to Databricks Delta tables.

Query system tables and manage file volumes in Databricks Unity Catalog.

Migrate Databricks workloads from classic compute to serverless with compatibility checks and fixes.

Build custom Python connectors to read and write data between Spark and external systems.

Set up and run AI evaluation pipelines with MLflow scorers and automated prompt optimization.

Create and deploy Databricks dashboards with validated SQL queries.

Generate realistic test datasets in Parquet, JSON, CSV, or Delta format at any scale.

Master advanced SQL features, stored procedures, and warehouse optimization on Databricks.

Look up official Databricks documentation for APIs, features, and platform guidance.

Define and manage governed business metrics in YAML for consistent KPIs across teams.

Build production streaming pipelines with Kafka, joins, and real-time processing.

Manage serverless Postgres databases on Databricks with autoscaling and synced tables.

Authenticate, configure, and explore data with Databricks CLI commands.

Build batch or streaming data pipelines on Databricks with Python or SQL.

Run Python, Scala, SQL, or R code on Databricks clusters and manage compute infrastructure.

Build dashboards and data apps on the Databricks platform.

Generate synthetic PDFs with test questions for document retrieval evaluation on Databricks.

Create, configure, and deploy Databricks Declarative Automation Bundles for dashboards, jobs, and pipelines.

Build with Databricks SDK, Connect, CLI, and REST API.

Create and manage scalable REST API endpoints for LLMs and ML models.

Create and deploy data engineering jobs on Databricks using notebooks, Python, SQL, or pipelines.

Manage Apache Iceberg tables and enable cross-platform data sharing on Databricks.

Build web apps, dashboards, and APIs for Databricks with Python or TypeScript.

Build vector search indexes and semantic search applications on Databricks.

Create knowledge assistants and supervisor agents for document Q&A and multi-agent workflows.

Design production-ready Databricks projects using best practices and the medallion pattern.

Optimize Databricks cluster configurations and query performance for faster jobs.

Create and query Databricks Genie Spaces for natural language SQL exploration.

Apply production-ready patterns for Databricks Python SDK integrations and best practices.

Optimize Databricks spending through cluster policies, spot instances, and cost monitoring.