PinnedRory McManusAzure Synapse Spark Pool: PySpark Upsert Function for Azure SQLAn Upsert is an RDBMS feature that allows a DML statement author to automatically either insert a row or if the row already exists, update…3 min read·Mar 6, 2022----
Rory McManusinTowards AIIoT Real Time Analytics — WAGO PLC with Databricks Auto LoaderModern businesses have an overwhelming amount of data available to them from a huge number of IoT devices and applications, in wide and…5 min read·Sep 3, 2022----
Rory McManusinTowards AIAzure Data Explorer: Real-Time Analytics — Fortinet LogsAzure Data Explorer (ADX) is a fully managed data analytics service for real-time analysis on large volumes of data streaming from…6 min read·Jan 11, 2022----
Rory McManusinTowards AIDatabricks PySpark Type 2 SCD Function for Azure Synapse AnalyticsSlowly Changing Dimensions (SCD) is a commonly used dimensional modelling technique used in data warehousing to capture the changing data…4 min read·Feb 19, 2021--4--4
Rory McManusinTowards AIDatabricks: Upsert to Azure SQL using PySparkAn Upsert is an RDBMS feature that allows a DML statement’s author to automatically either insert a row or if the row already exists…3 min read·Feb 19, 2021--2--2
Rory McManusinTowards AIAzure Cognitive Services Sentiment Analysis V3— Using PySparkWhat is Azure Cognitive Services — Text Analytics?4 min read·Sep 2, 2020----