THE DATA ENGINEER Topics ~sauru_6527

 Topics:

Databricks

  • Naval Yemul Playlist [  ]
  • Rajas DE [  ]
  • Partners Academy Course for Data Engineer : Link
Apache Spark
  • Course By Darshil Parmar [  ]
Azure Cloud

  • DataMaster: Naval yemul [  ]
UC Migration (Catalog: Hive to Unity )

  • 1 End to End Project  [  ]
Projects

  • Spotify [  ]
  • Uber [  ]
  • UC Migration [  ]

Delta Live Table (DLT) Framework

  • S/w Engineer Test [  ]
  •  Sample DLT with SQL Script Naval Yemul Playlist [ Done ]
Python 

  • Course by Darshil python for data engineer [  ]
  • Rishabh Pandey Bootcamp [  ]
  • Pyspark Functions [  ]
  • Practice [  ]
SQL

  • Practice [  ]
Presentation 
  • August Study Presentation in Celebal [Your Review of First Month] [  ]

Comments

Post a Comment

Popular posts from this blog

[ STRUCTURED ] Unity Catalog Concept in Databricks

Image
>>>  Topics in UC   Definition History Before UC After UC Features and Limitations Eg > >>Additional Terms   Catalog Binding Delta Sharing   Lakehouse Fedaration   _______________________________________________________________________ >>  Definition   Unified Governance solution + Data Security >> History Databricks Was lacking in Fundamental data governance centralization over databricks >> B4 Vs After Previous Approach:Without UC[Separate] Lack governance and Centralization Previously We have to do governance on each workspace individually Seperate User Management, Metastore We Used Data Cloning Activity which increased the data duplication and also cost Current Approach: With UC[One] Unity Catalog Centralized governance model sit at top of workspaces There is single entity from there you can govern each and every entity in your workspace from one place Main Challenge : 1. User Group: We dont had centralized pl...
Read more