Databricks Certified Data Engineer Associate Questions v2 & v3

Suggestions

• Practice from these notebooks throroughly and below pdf
  • de-mod-0-get-started-with-pyspark-programming
  • de-mod-1-get-started-with-databricks-data-science-and-engineering-workspace
  • de-mod-2-transform-data-with-spark
  • de-mod-3-manage-data-with-delta-lake
  • de-mod-4-build-data-pipelines-with-delta-live-tables
  • de-mod-5-deploy-workloads-with-databricks-workflows
  • Udemy Practice[You can try this. Use Udemy for Bussiness for free]
  • Udemy Practice[You can try this. Use Udemy for Bussiness for free]
• Practice "PracticeExam" questions available in this repo.
• Every options in "PracticeExam" question becomes a question in actual exam.
• Read Databricks Certified Associate Data Engineer Exam thoroughly.
• Read Manage data with delta lake
• Read Build pipeline with DLT

Repo link

Topics

1. Why might data not be available in a Delta Lake table?
   • Hint: Consider commands like vacuum, merge, or optimize.
2. What does Delta Lake become in the context of a data platform?
   • Hint: Think about the concept of a single source of truth.
3. What does a Delta table contain in terms of history, metadata, and data?
   • Hint: Does it have single or multiple files?
4. What is an advantage of Delta Lake over a traditional data lake?
5. Which component is a web application a part of in Databricks architecture?
   • Hint: Control plane or Data plane?
6. What operations need to be done outside of a Databricks repo?
   • Hint: Consider operations like pull, push, commit, or clone.
7. What is an advantage of using a repo over notebook versioning in Databricks?
   • Hint: Consider branching.
8. Is Delta Lake ACID compliant?
9. How can you avoid duplicates when merging data in a Delta Lake table?
   • Hint: MERGE command.
10. What should you consider when using the INSERT OVERWRITE command?
11. What is the purpose of using Z-ordering in Databricks?
    • Hint: For query performance optimization.
12. Why might the COPY INTO command not work in a particular code block?
    • Hint: Refer to this documentation.
13. What happens when using Expect or Drop on violation in Delta Live Tables (DLT)?
    • Hint: Refer to this documentation.
14. When should you use GRANT ALL PRIVILEGES in Unity Catalog?
15. When should you use GRANT USAGE in Unity Catalog?
16. What is an advantage of using array functions in Spark?
17. How do you set processingTime to 5 seconds in a streaming query?
    • Hint: Refer to the practice exam question.
18. How do you configure a streaming query for continuous processing in a production environment?
    • Hint: Refer to practice exam Q36.
19. Which physical object should you create for 10 tables so that other teams can use them in Databricks?
20. How can you delete metadata but retain the data files in a Delta table?
    • Hint: Consider the concept of an external table.
21. What happens when a stream is marked as "Streaming Live" in Databricks?
    • Hint: Refer to the practice exam question.
22. How can you mark a table as containing PII data in Databricks?
    • Hint: Use a comment during table creation.
23. How can you describe a database in Databricks to get the path for customer360?
24. What is the advantage of a gold table over a silver table in Delta Lake?
25. What is the difference between a bronze table and a raw table in Delta Lake?
26. How do you identity silver or bronze in Databricks?
    • Hint: Refer to practice exam Q31.
27. How do you create dependent tasks in a Delta Live Tables (DLT) pipeline?
28. How can you speed up query execution in Databricks?
    • Hint: Refer to the practice exam question.
29. How can you prevent a specific block of code from running on Sundays in Databricks?
30. Where can you see data quality metrics in Delta Live Tables (DLT)?
31. How can you execute a Delta Live Tables (DLT) pipeline?
32. How can you save costs using a serverless SQL warehouse or control DBU usage?
33. If a manager is concerned about project over-costing, how can you save costs in Databricks?
    • Hint: Consider the impact of using serverless endpoints, auto-stop, etc.
34. How can you reduce cluster costs in Databricks?
    • Hint: Consider adding an auto-stop setting in a SQL endpoint.
35. Refer question Q40 from the practice exam?
36. Refer question Q1 from the practice exam?
37. Refer question Q3 from the practice exam?
38. Which command or method is more appropriate for accessing a table in PySpark: spark.table("mytable"), spark.delta.table("mytable"), or spark.sql("mytable")?
39. What is the JDBC driver name for SQLite when connecting via Spark?
40. Given two tables, march_transaction and april_transaction, how can you create a new table all_transaction without duplicates?
    • Hint: Consider using join, merge, or union.
41. Refer question Q27 from the practice exam?
42. Refer question Q33 from the practice exam?
43. How do you check the failed status of a task in a Delta Live Tables (DLT) pipeline?
44. Which should be used to trigger alerts in Databricks: a webhook or an email alert?
45. How can you speed up query execution using cluster pools in Databricks?

Lessons Learned

No matter what, please attempt the practice exam thoroughly. The answers in each question becomes another question. You will have ample amount of time during assessment.