Search

Zayn
Zayn @Zayn__27S ·
Get expert PySpark Job Support & Proxy Support for real-time projects! Assistance with Apache Spark, ETL pipelines, big data, Spark SQL & data engineering. 📞 +91 9176533433 📧 info@intellimindz.com 🌐 tinyurl.com/47893kyk #PySparkIXD
16
aditya
aditya @adityaKoushik6 ·
Day -25 Spark -preparation started different import modes in spark and how to use sql inside spark and next iam planning to start transformations inside spark without sql #ConsistencyWins #pyspark #data #learn #day
aditya aditya @adityaKoushik6 ·
Day-23, 24 Learned spark Rdd Transformation(map, filter, sort, groupbykey, reducebykey, Cartiestion,repartition,flatmap, union,distinct, join, coalesce) Actions(collect, for each, take(), first, count, reduce, saveastextfile, sequencefile) #LearningInPublic #study #data #study
46
Fuzztaro
Fuzztaro @hirai_nobuaki ·
CI/CDシリーズ第3回書きました（英語）。 ETLレイヤーの設計判断5つ。全部「クラスタなしでテストできるか？」から逆算してる。 wheel化、overwrite戦略、Goldをviewにした理由、テスト環境の分離、カタログ解決の間接化。 platform-notes.hashnode.dev/terraform-data… #Databricks #PySpark #Azure #DataEngineering
Terraform & Databricks CI/CD Part 3: The Design Decisions Behind the Job Layer

Where We Left Off Part 1 of this series stood up the Azure infrastructure and Databricks workspace via Terraform. Part 2 added the Unity Catalog layer — catalog, schemas, and grants — managed through

From platform-notes.hashnode.dev
131
Zayn
Zayn @Zayn__27S ·
Boost your career with Online PySpark Job Support 🚀 Get expert help in Big Data, Apache Spark, Spark SQL, data engineering, ETL, troubleshooting & real-time project support. 📞 +91 9176533433 📧 hr@onlinejobsupport.net 🌐 tinyurl.com/mvtpta4f #PySparkymOe
28