Rory McManus – Medium

Pinned

Rory McManus

Azure Synapse Spark Pool: PySpark Upsert Function for Azure SQL

An Upsert is an RDBMS feature that allows a DML statement author to automatically either insert a row or if the row already exists, update…

3 min readMar 6, 2022

--

Azure Synapse Spark Pool: PySpark Upsert Function for Azure SQL

--

Rory McManus
in
Towards AI

IoT Real Time Analytics — WAGO PLC with Databricks Auto Loader

Modern businesses have an overwhelming amount of data available to them from a huge number of IoT devices and applications, in wide and…

5 min readSep 3, 2022

--

IoT Real Time Analytics — WAGO PLC with Databricks Auto Loader

--

Rory McManus
in
Towards AI

Azure Data Explorer: Real-Time Analytics — Fortinet Logs

Azure Data Explorer (ADX) is a fully managed data analytics service for real-time analysis on large volumes of data streaming from…

6 min readJan 11, 2022

--

Azure Data Explorer: Real-Time Analytics — Fortinet Logs

--

Rory McManus
in
Towards AI

Databricks PySpark Type 2 SCD Function for Azure Synapse Analytics

Slowly Changing Dimensions (SCD) is a commonly used dimensional modelling technique used in data warehousing to capture the changing data…

4 min readFeb 19, 2021

--

4

Databricks PySpark Type 2 SCD Function for Azure Synapse Analytics

--

4

Rory McManus
in
Towards AI

Databricks: Upsert to Azure SQL using PySpark

An Upsert is an RDBMS feature that allows a DML statement’s author to automatically either insert a row or if the row already exists…

3 min readFeb 19, 2021

--

2

Databricks: Upsert to Azure SQL using PySpark

--

2

Rory McManus
in
Towards AI

Azure Cognitive Services Sentiment Analysis V3— Using PySpark

What is Azure Cognitive Services — Text Analytics?

4 min readSep 2, 2020

--

Azure Cognitive Services Sentiment Analysis V3— Using PySpark

--

Rory McManus

Rory McManus

Director of Engineering & Owner Data Mastery | Official Azure Synapse Influencer & Databricks Master Sports enthusiast, sweet lover and triathlete!

Following

Help
Status
About
Careers
Blog
Privacy
Terms
Text to speech
Teams