shorya sharma – Medium

shorya sharma

Beyond Batch: Real-Time ETL with Spark Structured Streaming on Databricks using best practices…

In the dynamic landscape of big data analytics, the demand for real-time insights has become paramount. As organizations strive to make…

7 min readDec 26, 2023

--

Beyond Batch: Real-Time ETL with Spark Structured Streaming on Databricks using best practices…

--

shorya sharma

Payment Risk and Fraud: Part 3— A Decision Tree Case Study for Enhanced Business Performance

This is the final part of our series where we will work on a case study and will develop a Decision tree to reduce fraud.

4 min readNov 28, 2023

--

Payment Risk and Fraud: Part 3— A Decision Tree Case Study for Enhanced Business Performance

--

shorya sharma

Payment Risk and Fraud: Part 2 — Understanding Different Transaction Risks

Welcome back to our journey into the intricate landscape of payment risks and fraud. In Part 1, we laid the foundation, understanding the…

6 min readNov 18, 2023

--

Payment Risk and Fraud: Part 2 — Understanding Different Transaction Risks

--

shorya sharma

Payment Risk and Fraud : Part 1 — The Overview

Picture this: you’re buying something online, and in the blink of an eye, your payment zips through the internet to make the purchase…

10 min readNov 11, 2023

--

Payment Risk and Fraud : Part 1 — The Overview

--

shorya sharma

Data Engineering Interview Questions

In this blog, we’ll delve into some common data engineering questions and solutions, showcasing the techniques and best practices that…

5 min readSep 23, 2023

--

Data Engineering Interview Questions

--

shorya sharma

Pyspark Interview Preparation Part 3: Coding Practice

In this blog we will cover two Pyspark Questions for Interview preperation, both the questions are in the form of case study that companies…

4 min readSep 2, 2023

--

Pyspark Interview Preparation Part 3: Coding Practice

--

shorya sharma

Unlocking Insights: Interpreting Clustering Results through Decision Trees

In the world of data analysis and pattern recognition, clustering stands as a powerful technique to uncover underlying structures within…

5 min readJul 22, 2023

--

Unlocking Insights: Interpreting Clustering Results through Decision Trees

--

shorya sharma

Credit card fraud detection with Snap ML and Scikit learn

What is Scikit Learn?

6 min readJul 2, 2023

--

Credit card fraud detection with Snap ML and Scikit learn

--

shorya sharma

Machine learning with Pyspark MLlib: Part 1 Regression

MLlib is Spark’s machine learning (ML) library. Its goal is to make practical machine learning scalable and easy. At a high level, it…

7 min readJun 20, 2023

--

Machine learning with Pyspark MLlib: Part 1 Regression

--

shorya sharma

Developing a DataLake using Dataproc

This is part 3 and final part of our series on basics of data engineering on google cloud and hence will be a long one by the end of this…

7 min readApr 29, 2023

--

Developing a DataLake using Dataproc

--

shorya sharma

shorya sharma

Assistant Manager at Bank Of America | Ex-Data Engineer at IBM | Ex - Software Engineer at Compunnel inc. | Python | Data Science

Following

Help
Status
About
Careers
Blog
Privacy
Terms
Text to speech
Teams