AA_Collage_02 (2) pattents-img pattents-img

Blogs

Thanks for reading. Here you will find a huge range of information in text, audio and video on topics such as Data Science, Data Engineering, Machine Learning Engineering, DataOps and much more. The show notes for “Data Science in Production” are also collated here.

pattern
Vector (44)
border-traingle

Recent Blogs

Filter By Tag
Filter By Author
AI Generative AI LLM
Author vector
Gavita Regunath
Streamline Your RAG Pipeline Evaluation with Synthetic Data
Imagine slashing your data labelling time by 90% while improving the accuracy of your RAG...

27th August, 2024

Read More
Data Chief Data Officer Analytics Data Strategy
Author vector
Ust Oldfield
Unlocking the True Value of Data: Applying Economic Theories to Data
In this blog post, we delve into the economic principles that can help quantify the value of...

31st July, 2024

Read More
AI Data Science MLOps Generative AI
Author vector
Tori Tompkins
5 Essential Evaluation Metrics for LLMOps & FMOps (and how to...
Evaluating large language models (LLMs) is crucial to ensure their effectiveness, reliability,...

17th July, 2024

Read More
Chief Data Officer AI Events Retail CPG
Author vector
Terry McCann
Must Attend Data Conferences for CDAOs in Retail
Why attend events? Unless you are new around here you will be aware that at Advancing...

17th June, 2024

Read More
Author vector
Christopher Durow
Can GraphRAG finally solve the Kendrick & Drake dispute?
Following on from Part 1 where I introduced GraphQL and it’s popularity let’s take that a step...

20th May, 2024

Read More
Author vector
Diversity & Inclusion Team
IDAHOBIT Day: A Beacon for Equality and the Prelude to Pride Season
Introduction The International Day Against Homophobia, Biphobia, and Transphobia (IDAHOBIT) is...

16th May, 2024

Read More
Data
Author vector
Christopher Durow
The Rise of GraphQL
Introduction: With a world wide industry market cap of $7.1 trillion and substantial...

14th May, 2024

Read More
Author vector
Ust Oldfield
Partnering with dbt Labs: enhancing our analytical engineering...
Advancing Analytics are thrilled to announce that we have partnered with dbt Labs, the company...

6th May, 2024

Read More
Author vector
Alexandru Malanca
LLMOps With PromptFlow
Imagine stepping into a world where artificial intelligence (AI) and machine learning (ML)...

29th April, 2024

Read More
AI
Author vector
Gavita Regunath
Comparison of Prompt Flow, Semantic Kernel, and LangChain for AI...
Introduction The world of AI is moving super fast! It's like we're on a speedy train, watching...

9th April, 2024

Read More
Author vector
Johnny Winter
Why Data Products are a terrible idea!
Data Products Data Products are currently experiencing a rise in prominence largely due to the...

1st April, 2024

Read More
Author vector
Alexandru Malanca
Sound the alarm! Why you should start thinking about your LLM...
As the digital landscape braces for a transformative AI shift, the spotlight turns to...

1st April, 2024

Read More
Author vector
Nikki Kelly
A Journey to Data and AI Maturity
Data and AI Maturity is a journey that every organisation is on, whether they are aware or...

11th March, 2024

Read More
Author vector
Diversity & Inclusion Team
Celebrating Chinese New Year 2024 - The Year of the Dragon
As a round-up for February from the DIBs team, we bid farewell to the Year of the Tiger, and...

28th February, 2024

Read More
Data Data Governance
Author vector
Falek Miah
An Ultimate Guide to Databricks Unity Catalog
Databricks Unity Catalog (UC) has gained significant attention lately, with Databricks making...

6th February, 2024

Read More
Data Governance
Author vector
Nikki Kelly
Data Governance: Embrace the Boring Stuff
Data Governance – you have heard the term a million times and not once has it driven...

25th January, 2024

Read More
AI Generative AI
Author vector
Ed Oldham
Plate or Bowl: A Simple Case Study in Prompt Refinement
At Advancing Analytics, we have a question we like to ask new hires: Are you a plate or a...

24th January, 2024

Read More
Fabric
Author vector
Ed Oldham
Fabric Notebook Concurrency Explained: Update
Fabric Concurrency Fabric has been in general availability for a couple of months now, I...

15th January, 2024

Read More
Analytics Fabric
Author vector
Johnny Winter
Haberdashery! The Ultimate Analytics Engineering Guide to Curating...
Analytics Engineering is a subject close to my heart, having emerged as a new discipline over...

9th January, 2024

Read More
Author vector
Dylan Jones
Introduction to Polars
If you’ve ever used Python for analytics you’ll have no doubt heard of Pandas, the incredibly...

3rd January, 2024

Read More
Fabric
Author vector
Ed Oldham
Fabric Notebook Concurrency Explained
If you keep up with the latest developments in the data space, you will probably know that...

18th December, 2023

Read More
Fabric
Author vector
Johnny Winter
Dude, Where's my Copilot?
You couldn’t miss all of the Copilot hype at Microsoft Ignite this year, and of course that...

15th December, 2023

Read More
Author vector
Nikki Kelly
Why you should be a Data Culture Vulture
Data culture refers to an organisation's collective mindset and behaviour when it comes to...

13th December, 2023

Read More
Data Engineering Analytics
Author vector
Johnny Winter
When is an Aggregate not an Aggregate?
I am irked. As a father of two high school aged children, this is not uncommon, but for once...

11th December, 2023

Read More
Analytics Fabric
Author vector
Johnny Winter
Fabric and Tabular Editor
It’s no secret that I’m a big advocate of Tabular Editor (TE). I recently wrote about it on my...

28th November, 2023

Read More
Author vector
Tori Tompkins
Microsoft Ignite 2023 - AI Roundup
AI was the very first thing mentioned in Satya Nadella’s opening keynote of Microsoft Ignite...

22nd November, 2023

Read More
Fabric
Author vector
Craig Porteous
Microsoft Ignite 2023 – Fabric Round-up
Last week was Microsoft’s Ignite conference hosted in Seattle and we were on the edge of our...

20th November, 2023

Read More
Author vector
Alexander Billington
The 4 Best Vector Database Options for your LLM Projects
As the potential of Generative AI and Large Language (LLM) models continue to grow at a...

16th November, 2023

Read More
AI Data Science
Author vector
Luke Menzies
How Intel technology stack improved model training in Advancing...
The ability of AI to transform and improve processes for businesses is seen across many...

13th November, 2023

Read More
AI Generative AI
Author vector
Gavita Regunath
10 Reasons Why You Need to Implement RAG – A Game-Changer in AI!
In today's rapidly evolving AI landscape, large language models (LLM) are making waves across...

8th November, 2023

Read More
Author vector
Alexandru Malanca
Azure’s PromptFlow: Deploying LLM Applications in Production
In the ever-changing world of Artificial Intelligence (AI), new tools and frameworks are...

8th November, 2023

Read More
Fabric
Author vector
Johnny Winter
YOUR NEW ACTION HERO! What is Data Activator?
Data Activator is the newest experience to be added to Microsoft’s unified...

19th October, 2023

Read More
Author vector
Alexandru Malanca
Unleash the Power of AI Without Breaking the Bank: A Guide to Azure...
Inspired by Shishir Garde's informative piece on Azure Budgets and Azure OpenAI Cost...

18th October, 2023

Read More
DevOps
Author vector
Ust Oldfield
How to Achieve Perfect Sprint Planning
This title is a misnomer as perfection is a fallacy, and there’s no such thing as perfect. So...

18th October, 2023

Read More
Analytics
Author vector
Johnny Winter
Is your Data Demoralized?
Let me introduce you to the hippest new buzzword term in the data world; Data Demoralization....

4th October, 2023

Read More
Announcements
Author vector
Zach Stagers
Hydr8 Achieves Databricks Brickbuilder Status
Earlier today, Advancing Analytics and our Data Lakehouse Accelerator, Hydr8, were announced...

3rd October, 2023

Read More
AI
Author vector
Alexandru Malanca
AI-Driven Employee Empowerment: Crafting Tailored Learning Paths for...
In the rapidly evolving world of work, continuous learning and skill development are more...

13th September, 2023

Read More
Data Science Fabric
Author vector
Tori Tompkins
Exploring Machine Learning in Microsoft Fabric: Should Data...
Introduction Fabric is Microsoft’s recently announced SaaS all-in-one analytics platform. It...

10th September, 2023

Read More
Events Announcements Company
Author vector
Isi Turner
Introducing 'Ask Databricks': Your Direct Line to Product Experts
Have you ever wondered about the people behind Databricks’ products and tools? What vision...

22nd August, 2023

Read More
Fabric
Author vector
Johnny Winter
What's in a name? Naming your Fabric artifacts
Who Cares? Does it really matter what you call your artifacts when you create them in a Fabric...

17th August, 2023

Read More
Case Study Company
Author vector
Gareth Rowen
Project Lighthouse: Leveraging Walmart Luminate for Data-Driven...
The world of CPG and retail is evolving more rapidly than ever, increasing the pressure on...

3rd August, 2023

Read More
Author vector
Aimee Johnson
Getting Started with Microsoft Fabric Licensing
Microsoft Fabric is a Software-as-a-Service platform (SaaS) which enables you to build an...

1st August, 2023

Read More
Author vector
Dylan Jones
Tips for the Databricks Certified Data Analyst Associate Certification
Following on from my previous blog post about the Data Engineer Associate certification, this...

26th July, 2023

Read More
Visualisation
Author vector
Hope Archer
Tableau vs. Power BI: A Comparison of Leading Data Visualisation Tools
In the realm of data visualisation and analytics, Tableau and Power BI have emerged as two...

23rd July, 2023

Read More
Author vector
Jordan Witcombe
Microsoft Fabric: An End to End Implementation
This blog will walk you through the entire data lifecycle of ingesting data from SharePoint...

19th July, 2023

Read More
Author vector
Connor Quinn
A Well-architected Lakehouse with Hydr8
The Azure well-architected framework is a set of principles to help you achieve excellence in...

16th July, 2023

Read More
Author vector
Aimee
Architecting a Successful Analytics Platform in Microsoft Fabric
It’s really easy to get started with Microsoft Fabric. We can ingest data, transform it, and...

11th July, 2023

Read More
Author vector
Alexandru Malanca
Large Language Models as Collaborative Tools in BEAM Sessions
A few weeks ago I had the privilege of attending a three-day training course on Business Event...

27th June, 2023

Read More
Author vector
Ust Oldfield
Bringing Fabric to your Data Lakehouse
We've built countless Lakehouses for our customers and influenced the design of many more....

26th June, 2023

Read More
Author vector
Jordan Witcombe
The Power of Verti-parquet & DirectLake in Fabric
In the data engineering field these are two pain points at the core of our work. We must...

19th June, 2023

Read More
Author vector
Sahil Osman
World Refugee Day
What is World Refugee Day? Every year on June 20th, the world comes together to recognise...

19th June, 2023

Read More
Author vector
Aimee Johnson
Data Lakehouse vs Data Warehouse in Microsoft Fabric
If you have had a play around with Microsoft Fabric you will have seen that there are lots of...

15th June, 2023

Read More
Author vector
Jordan Witcombe
Microsoft Fabric: An introduction to OneLake
As data engineers, we face many challenges daily. Data is often distributed across many...

6th June, 2023

Read More
Author vector
Aimee Johnson
10 Amazing Features of Microsoft Fabric!
Fabric is Microsoft’s brand-new SaaS analytics platform just announced at their Build...

24th May, 2023

Read More
Author vector
Aimee Johnson
What is Microsoft Fabric? An Introduction
What is Microsoft Fabric? Fabric is Microsoft’s shiny new all-encompassing...

16th May, 2023

Read More
Data Engineering
Author vector
Falek Miah
Using Databricks SQL in VSCode
Recently, I had the opportunity to explore the Databricks SQL extension for VSCode, and I was...

11th May, 2023

Read More
Data Engineering
Author vector
Falek Miah
Introduction to Databricks SQL
Databricks SQL is a powerful tool for querying and analysing data in Databricks Lakehouse. It...

11th May, 2023

Read More
Author vector
Ed Oldham
Medallion Architecture: What is it?
Businesses are currently in a data Gold Rush. With the vast array of Data Sources and types of...

1st May, 2023

Read More
Author vector
Ayodeji Ogunlami
A Hybrid Approach to Fraud Detection
Image from Financial IT Being able to detect fraud is one of the major issues faced by...

25th April, 2023

Read More
AI Data Science Machine Learning
Author vector
Gavita Regunath
Azure OpenAI vs OpenAI: What's the Difference?
Written by Gavita Regunath and Anna Wykes TL;DR: Azure OpenAI Service provides a safe and...

23rd April, 2023

Read More
Author vector
Dylan Jones
Tips for the Databricks Certified Data Engineer Associate...
After passing the Databricks Certified Data Engineer Associate certification in July of last...

19th April, 2023

Read More
AI Data Science Machine Learning
Author vector
Gavita Regunath
Simplifying Machine Learning Deployment with Azure’s Managed Endpoints
This blog post was written jointly by Gavita Regunath, Principal Data Scientist at Advancing...

19th April, 2023

Read More
Author vector
Alexander Billington
MLOps - Hints and Tips for more Robust Model Deployments
Introduction Machine learning (ML) model deployment is a critical part of the MLOps lifecycle,...

30th March, 2023

Read More
Author vector
Alexander Billington
MLOps - A Quick and Easy Guide to Model Deployment using Azure...
Introduction Deploying machine learning (ML) models into production can be challenging, as it...

23rd March, 2023

Read More
Events
Author vector
Diversity & Inclusion Team
Supporting Colleagues during Ramadan
The Basics What is Ramadan? Ramadan is the 9th month of the Islamic calendar. It is considered...

22nd March, 2023

Read More
Author vector
Shannon Bloye
An Introduction to SunBeam
SunBeam™ is a data modelling approach established at Advancing Analytics by our resident Power...

2nd March, 2023

Read More
AI Data Science Machine Learning
Author vector
Gavita Regunath
10 reasons why Azure Databricks for Machine Learning Rocks!
The world of machine learning is constantly evolving, and businesses today face many...

14th February, 2023

Read More
Author vector
Alexander Billington
Image Classification — Dealing with Imbalance in Datasets
Introduction Image classification is a standard computer vision task and involves training a...

2nd February, 2023

Read More
AI Data Science Announcements Machine Learning
Author vector
Gavita Regunath
Partnering with Dataiku: Enhancing Our Data Science and Machine...
Advancing Analytics are thrilled to announce that we have teamed up with Dataiku, the platform...

30th January, 2023

Read More
AI Data Science Machine Learning
Author vector
Gavita Regunath
Maximising Customer Value with 360 View and Machine Learning
We all know the phrase "customer is king"— it's all about putting the customer at the centre...

27th January, 2023

Read More
AI
Author vector
Guest User
Retail Customer Upsell. Using a Classification Model on a Kaggle...
What is this article about? This article will follow the process of using a classification...

25th January, 2023

Read More
AI
Author vector
Terry McCann
Overcoming Manufacturing Industry Challenges with Big Data. Demand...
Manufacturing is an industry that is increasingly turning to data and artificial intelligence...

23rd January, 2023

Read More
Chief Data Officer Engineering
Author vector
Simon Whiteley
Has the Data Engineer replaced the Business Intelligence Developer?
It seems these days that every person I talk to is either a scientist, engineer or architect,...

22nd January, 2023

Read More
Chief Data Officer
Author vector
Terry McCann
Exploring the Differences: Multi-dimensional Modeling vs Relational...
Reinventing new solutions Over the weekend I joined an ongoing question about what is a Data...

22nd January, 2023

Read More
AI
Author vector
Terry McCann
Understanding ChatGPT as explained by ChatGPT
In 2022 Language models exploded in popularity. Their uses are seeping into every aspect of...

18th January, 2023

Read More
Author vector
Ayodeji Ogunlami
UNDERSTANDING RECOMMENDATION ENGINES
At present, recommendation engines have gained popularity within the businesses and e-commerce...

12th January, 2023

Read More
Author vector
Luke Menzies
GIS in Databricks
Introduction The topic of Geographic Information Systems (GIS), finds its way into the data...

3rd January, 2023

Read More
Author vector
Ust Oldfield
Seeding Files With dbt
File seeding is a useful way of maintaining and deploying static, or very slowly changing,...

15th December, 2022

Read More
Author vector
Ust Oldfield
Getting Started with dbt
What is dbt? dbt is an abbreviation for data build tools. It is primarily a SQL based...

5th December, 2022

Read More
Author vector
Ust Oldfield
Introduction to Analytics Engineering
Analytics Engineering is a relatively new term in the world of data, having been pioneered by...

30th November, 2022

Read More
Author vector
Luke Menzies
Distil8 — Solution Accelerators
Many businesses recognise the benefits of Artificial Intelligence (AI) and Machine Learning...

16th October, 2022

Read More
Visualisation
Author vector
Jordan Witcombe
Tableau Tutorials: How to Create a Parameterized Table
Let’s say you’re planning to present a large table of information and you want the user to be...

30th August, 2022

Read More
Author vector
Torr Wylder
What is Kubernetes?
What is Kubernetes? "Kubernetes is a portable, extensible, open source platform for managing...

10th August, 2022

Read More
MLOps
Author vector
Tori Tompkins
Feature Stores and Why You Need Them
The Machine Learning and DevOps are generally well established within the data industry, with...

1st August, 2022

Read More
Author vector
Ust Oldfield
Sustainability Reporting Accelerator
Social expectations of businesses and industries are increasing—in relation to Environment,...

26th July, 2022

Read More
Data Security Announcements
Author vector
Craig Porteous
Data + AI Summit recap - Data sharing announcements
Amid the plethora of announcements coming out of the DATA + AI Summit a few weeks back, there...

17th July, 2022

Read More
Data Science
Author vector
Terry McCann
Starting Advancing Analytics
I am super excited to announce my new venture. For the last 2 years I have been working for...

12th July, 2022

Read More
AI Data Science Announcements Machine Learning
Author vector
Gavita Regunath
Data and AI Summit 2022 ML Announcements
With 5000 in-person attendees and 60,000 online attendees at the Data and AI Summit 2022...

3rd July, 2022

Read More
Author vector
Zach Stagers
Data and AI Summit 2022 Announcements
With the Advancing Analytics team having dispersed from San Francisco following an incredible...

3rd July, 2022

Read More
AI Data Science Machine Learning
Author vector
Gavita Regunath
Get Started with Clustering: The Easy Way
How does clustering work, and why is it so important for businesses? This article provides a...

13th June, 2022

Read More
AI Data Science Machine Learning
Author vector
Gavita Regunath
10 Incredibly Useful Clustering Algorithms
In the previous article, we explained how clustering, an unsupervised machine learning method,...

13th June, 2022

Read More
Engineering
Author vector
Chris Williams
Tips for the Databricks Certified Associate Developer for Apache...
After diving in to (and passing!) the Associate Developer for Apache Spark 3.0 exam...

7th June, 2022

Read More
Engineering
Author vector
Chris Williams
Tips for the Databricks Certified Associate Developer for Apache...
Following on from my previous post I wanted to cover off some more key topics that can really...

7th June, 2022

Read More
Author vector
Tori Tompkins
What is MLOps and Why Do You Need It?
MLOps (Machine Learning Operations) is the set of processes for the production ML lifecycle,...

5th June, 2022

Read More
Author vector
Tori Tompkins
Model Deployment Options in Azure
There are so many options to deploy models in Azure that is can get quite overwhelming. In...

24th May, 2022

Read More
AI Machine Learning
Author vector
Gavita Regunath
Opening the eyes of the machine: Computer vision with AutoML (Part 1)
By Gavita Regunath and Dan Lantos Automated Machine Learning, or AutoML, has gained a lot of...

22nd May, 2022

Read More
Uncategorized
Author vector
Terry McCann
How NeoInsurance is disrupting traditional Insurance
Insurance Disruption How NeoInsurance and Insuretech are changing the way we cover consumers...

19th May, 2022

Read More
AI
Author vector
Terry McCann
10 Ways AI & Machine Learning can drive Revenue in Insurance
Last week, Advancing Analytics attended BIBA 2022. It was a great opportunity to catch up with...

13th May, 2022

Read More
AI Data Science Machine Learning
Author vector
Gavita Regunath
The No-Code Road to Churn Prediction
For any service company that bills on a recurring basis, a key variable is the rate of churn....

8th May, 2022

Read More
Data Security
Author vector
Craig Porteous
Design an Azure Data Platform that InfoSec will love - Azure Storage
This is the third in a series where I look at all of the resources common to a Data Lakehouse...

3rd May, 2022

Read More
Data Security
Author vector
Craig Porteous
Design an Azure Data Platform that InfoSec will love – Azure...
In the first post of this series, I set out the foundation of our secure Data Lakehouse. It...

24th April, 2022

Read More
Data Security
Author vector
Craig Porteous
Design an Azure Data Platform that InfoSec will love
Reference architectures are great! You've got all of the key components in there, nice and...

13th April, 2022

Read More
Engineering
Author vector
Falek Miah
Writing a Single JSON File in Databricks
When writing to a JSON destination using the DataFrameWriter the dataset is split into...

24th March, 2022

Read More
Engineering Serverless Computing
Author vector
Zach Stagers
Azure Synapse Serverless Lake Access Patterns
I've been working with a client to build a large Data Lakehouse platform predominantly using...

23rd March, 2022

Read More
Author vector
Ust Oldfield
Why Data Quality is Important
Data is among the most valuable assets for any organisation. Without data, the ability to make...

15th March, 2022

Read More
Author vector
Tori Tompkins
Using GPT-3 Model to Generate Romantic Comedy Movie Summaries
Valentines Day is approaching and what better way to celebrate than to play around with AI...

8th February, 2022

Read More
Author vector
Tori Tompkins
Querying Movie Data on Wikipedia using DBpedia and SPARQL
Getting data from Wikipedia is no easy feat. At first glance, it seems like the easiest way...

8th February, 2022

Read More
Events
Author vector
Zach Stagers
Advancing Analytics at SQLBits 2022
SQLBits 2022 is just around the corner, taking place between March 8th and 12th at the ExCel...

3rd February, 2022

Read More
Author vector
Alexander Billington
Recommender Systems — Using Snorkel for Relevance Labelling
Introduction to Snorkel Created in Stanford in 2016, Snorkel is a system for programmatically...

19th January, 2022

Read More
Author vector
Grace OHalloran
On-Premise Self Hosted Integration Runtime for Azure Data Factory:...
Introduction In this post I will discuss the solution to a problem that plagued me on a client...

19th January, 2022

Read More
Author vector
Tori Tompkins
Getting Started with Graph Analysis in NetworkX
Introduction NetworkX is a Python package for the creation, manipulation, and study of the...

18th January, 2022

Read More
AI Data Science
Author vector
Gavita Regunath
A Beginner’s Guide To Understanding Feature Stores
Feature stores are rapidly gaining popularity in the machine learning environment. When I...

13th January, 2022

Read More
Author vector
Tori Tompkins
How to Fix Different Types of Model Drift
Introduction Model drift refers to the decline of model performance due to changes in data and...

11th January, 2022

Read More
Data Science
Author vector
Luke Menzies
Optimisation in Business
Introduction The word optimisation is thrown about in the business world, quite often due to...

11th January, 2022

Read More
Author vector
Anna Wykes
DevOps for Databricks: Using Rest API & Python in YML CI/CD Pipelines
Welcome to the third instalment in my DevOps for Databricks blog series. Here we will take the...

4th January, 2022

Read More
Author vector
Anna Wykes
DevOps for Databricks: Databricks Rest API & Python
In this blog series I explore a variety of options available for DevOps for Databricks. This...

21st December, 2021

Read More
Author vector
Grace OHalloran
Computer Network Basics
Introduction My motivation for writing this blog post was largely to share my own journey in...

21st December, 2021

Read More
AI
Author vector
Gavita Regunath
Understanding The Difference Between AI, ML, And DL: Using An...
I debated whether to write this piece for a long time. This was due to several factors. At a...

15th December, 2021

Read More
Engineering DevOps
Author vector
Anna Wykes
DevOps for Databricks: Getting Started
As a consultant and Data Engineer I’ve lost count of the number of times I’ve been asked “how...

13th December, 2021

Read More
Engineering
Author vector
Falek Miah
Databricks Execution Plans
The execution plans in Databricks allows you to understand how code will actually get executed...

10th October, 2021

Read More
Engineering Advancing Spark
Author vector
Falek Miah
Databricks Delta Cache and Spark Cache
As data sizes and demand increases as time goes on, you often see slowness on Databricks this...

26th September, 2021

Read More
Author vector
Chris Williams
Slowly Changing Dimensions (SCD Type 2) with Delta and Databricks
From Warehouse to Lakehouse Pt.2 SCD Type 2 in SQL and Python Introduction For more...

26th September, 2021

Read More
Engineering
Author vector
Chris Williams
Slowly Changing Dimensions (SCD Type 1) with Delta and Databricks
From Warehouse to Lakehouse Pt.1 SCD Type 1 in SQL and Python Introduction With the move to...

6th September, 2021

Read More
Engineering Infrastructure As Code
Author vector
Falek Miah
Terraform Databricks Labs
In late 2020, Databricks introduced Databricks Labs a collection of Terraform Providers that...

1st September, 2021

Read More
Engineering Serverless Computing
Author vector
Grace OHalloran
An Introduction to Serverless Computing and Function-as-a-Service
What is Serverless Computing? The term serverless computing can be misleading; how can you...

1st September, 2021

Read More
Author vector
Gavita Regunath
6 Ways AI is Transforming the Finance Industry
"AI is the 'new electricity' … just as electricity transformed many industries roughly one...

25th August, 2021

Read More
Engineering
Author vector
Zach Stagers
Azure Data Lake ACL Introduction
Introduction to ACL’s Access Control Lists (ACLs) offer low-level control of access to the...

12th August, 2021

Read More
Author vector
Ust Oldfield
Databricks Labs: Data Generator
Databricks recently released the public preview of a Data Generator for use within Databricks...

8th August, 2021

Read More
Author vector
Ust Oldfield
Data Mesh Deep Dive
In a previous post, we laid down the foundational principles of a Data Mesh, and touched on...

4th August, 2021

Read More
Author vector
Ust Oldfield
What is Data Mesh?
To be able to properly describe what Data Mesh is, we need to contextualise in which...

4th August, 2021

Read More
Author vector
Guest User
Facebook Prophet and the Stock Market (Part 2)
Understanding how Prophet does what it does. Prophet-generated FTSE100 fitting and forecast....

3rd August, 2021

Read More
Author vector
Gavita Regunath
Explainability AI
Written by Dan Lantos, Ayodeji Ogunlami and Gavita Regunath TL;DR SHAP values are a...

26th July, 2021

Read More
Uncategorized
Author vector
Dan Lantos
Facebook Prophet and the Stock Market (Part 1)
Using Facebook’s Prophet library to forecast the FTSE 100 index. By Dan Lantos Photo by Maxim...

4th July, 2021

Read More
Author vector
Diversity & Inclusion Team
Pride 2021 and Advancing Analytics
The History of Pride Pride Month commemorates the June 1969 Stonewall Riots in New York City....

1st July, 2021

Read More
Uncategorized
Author vector
Gavita Regunath
10 Incredibly Useful Time Series Forecasting Algorithms
To Make An Impact In Your Business By Gavita Regunath and Dan Lantos “The goal of forecasting...

21st June, 2021

Read More
Author vector
Diversity & Inclusion Team
Mental Health Awareness Week 2021 at Advancing Analytics
All of us know someone who has experienced challenges with mental health. Whether they have...

11th May, 2021

Read More
Author vector
Diversity & Inclusion Team
Autism Awareness Week 2021 and Advancing Analytics
Autism, or autism spectrum disorder (ASD) is a complex, lifelong developmental disability....

31st March, 2021

Read More
Author vector
Diversity & Inclusion Team
International Trans Day of Visibility 2021 and Advancing Analytics
Today is International Trans Day of Visibility! An annual commemoration dedicated to raising...

30th March, 2021

Read More
Advancing Spark
Author vector
Terry McCann
Spark 3.0 Questions and answers from the Data AI Summit
At the Data + AI Summit, Simon delivered a session on “Achieving Lakehouse Models with Spark...

19th November, 2020

Read More
Chief Data Officer
Author vector
Simon Whiteley
Databricks SQL Analytics Workspace - The Evolution of the Lakehouse
We have discussed in the past this idea of the lakehouse, the aspirational target of many...

10th November, 2020

Read More
Announcements
Author vector
Terry McCann
Announcement: Microsoft Triple Gold Partner
We are incredibly pleased to announce that we have obtained another Gold Partner accreditation...

6th November, 2020

Read More
AI Advancing Spark
Author vector
Tori Tompkins
Identifying Data Outliers in Apache Spark 3.0
The secret to getting machine learning to work effectively is in ensuring that the data we are...

21st October, 2020

Read More
Company
Author vector
Guest User
We only have one planet, let’s look after it!
Advancing Analytics - CarbonNeutral® company certification From the beginning, Advancing...

24th September, 2020

Read More
AI Data Science Announcements
Author vector
Terry McCann
Deploy models (almost) anywhere with ONNX.ai
We often talk about productionisation of Machine Learning being the hardest problem in Data...

20th July, 2020

Read More
Advancing Spark Data Science
Author vector
Tori Tompkins
Will Koalas replace PySpark?
One of the first of many big announcements at the 2020 Spark and AI Summit was the official...

5th July, 2020

Read More
Author vector
Anna Wykes
Working with Data Schemas and Models in Scala: Case Classes
This is the third of my blogs in the Scala Parlour Series, in which we explore Scala, and why...

2nd July, 2020

Read More
Chief Data Officer
Author vector
Simon Whiteley
Understanding Azure Synapse Analytics
You might have seen that I’ve been pretty busy recently, digging into the new Azure Synapse...

15th June, 2020

Read More
Author vector
Anna Wykes
Scala For Big Data Engineering – Monads
This is the second of my blogs in the Scala Parlour Series, in which we explore Scala, and why...

4th June, 2020

Read More
Engineering
Author vector
Simon Whiteley
Azure Synapse Analytics - Microsoft's Flagship Lakehouse Now in...
Today’s the day! There’s much buzz & excitement as we FINALLY get to see Azure Synapse...

18th May, 2020

Read More
Hidden Layer
Author vector
Tori Tompkins
Selecting the right Recommendation System
Introduction Putting the right products in front of your customers at a time they are...

12th May, 2020

Read More
Data Engineering
Author vector
Anna Wykes
Scala For Big Data Engineering – Why should you care?
The thought of learning Scala fills many with fear, its very name often causes feelings of...

22nd April, 2020

Read More
Training
Author vector
Terry McCann
Practical Azure Databricks & Practical Azure Data Factory (May 2020...
We have partnered up again with our good friends at Orange Man in Denmark to deliver our Azure...

5th February, 2020

Read More
Chief Data Officer
Author vector
Simon Whiteley
The Data Lakehouse – Dismantling the Hype
That’s right, we’ve entered a new decade, it’s time for a new buzzword to define what we’re...

4th February, 2020

Read More
Announcements
Author vector
Terry McCann
Microsoft Gold Partners!
We are kicking off 2020 by announcing that we are now Gold Partners for both Data Platform and...

3rd February, 2020

Read More
Engineering
Author vector
Simon Whiteley
Data Engineer's Takeaways from Spark & AI Summit 2019
We spent the best part of October speaking at various conferences in Europe, but we took...

12th November, 2019

Read More
Training
Author vector
Terry McCann
Azure Data Factory & Databricks Training in Denmark
We have partnered up with our good friends at Orange Man in Denmark to deliver our Azure...

8th November, 2019

Read More
Events
Author vector
Terry McCann
European Conference Downloads and Stats
Today marks the end of our European conference tour. In the first 3 weeks of October we racked...

17th October, 2019

Read More
Events
Author vector
Terry McCann
Advancing Analytics in Europe. Microsoft MVP
In October and November we are going on tour and speaking at a load of different events. We...

16th September, 2019

Read More
Engineering Data Science
Author vector
Terry McCann
Caching and Persisting data in Apache Spark and Azure Databricks
Every day this month we will be releasing a new video on Azure Databricks. Today we are...

22nd July, 2019

Read More
Engineering Data Science
Author vector
Terry McCann
Using PySpark to Join DataFrames In Azure Databricks
Every day this month we will be releasing a new video on Azure Databricks. Today we are...

22nd July, 2019

Read More
Engineering Data Science
Author vector
Terry McCann
Working with Partitioned Data in Azure Databricks
Every day this month we will be releasing a new video on Azure Databricks. Today we are...

22nd July, 2019

Read More
Engineering Data Science
Author vector
Terry McCann
Apache Spark Transformations and Actions in Azure Databricks
Every day this month we will be releasing a new video on Azure Databricks. Today we are...

22nd July, 2019

Read More
Engineering Data Science
Author vector
Terry McCann
Version Controlling Notebooks in Azure Databricks and Azure DevOps
Every day this month we will be releasing a new video on Azure Databricks. Today we are...

22nd July, 2019

Read More
Engineering Data Science
Author vector
Terry McCann
Creating Your First Machine Learning Model in Azure Databricks
Every day this month we will be releasing a new video on Azure Databricks. Today we are...

22nd July, 2019

Read More
Engineering Data Science
Author vector
Terry McCann
Using Widgets to Create Configurable Notebooks in Azure Databricks
Every day this month we will be releasing a new video on Azure Databricks. Today we are...

22nd July, 2019

Read More
Engineering Data Science
Author vector
Terry McCann
Writing Data to Azure SQL Data Warehouse with Azure Databricks
Every day this month we will be releasing a new video on Azure Databricks. Today we are...

22nd July, 2019

Read More
Engineering Data Science
Author vector
Terry McCann
Reading and Writing Data Guidance for Azure Databricks
Every day this month we will be releasing a new video on Azure Databricks. Today we are...

22nd July, 2019

Read More
Engineering Data Science
Author vector
Terry McCann
Creating a Connection to Azure Data Lake Gen 2 with Azure Databricks
Every day this month we will be releasing a new video on Azure Databricks. Today we are...

22nd July, 2019

Read More
Engineering Data Science
Author vector
Terry McCann
Working with SQL using the DataFrame SQL API in Azure Databricks
Every day this month we will be releasing a new video on Azure Databricks. Today we are...

22nd July, 2019

Read More
Events
Author vector
Terry McCann
Spark & AI Summit Europe 2019
Today is the last day to get a reduced registration fee for the Spark & AI Summit in...

10th July, 2019

Read More
Podcast Data Science
Author vector
Terry McCann
Data Science In Production Episode 6: The Global AI Bootcamp with...
Hey Productionaneers, This Episode was recorded at the Intelligent Cloud Conference in...

8th July, 2019

Read More
Engineering Data Science
Author vector
Terry McCann
Getting Started with Notebooks in Azure Databricks
Every day this month we will be releasing a new video on Azure Databricks. Today we are...

7th July, 2019

Read More
Engineering Data Science
Author vector
Terry McCann
How do You Size Your Azure Databricks Clusters?
Every day this month we will be releasing a new video on Azure Databricks. We have done the...

4th July, 2019

Read More
Engineering Data Science
Author vector
Terry McCann
Creating and Configuring Clusters in Azure Databricks
Every day this month we will be releasing a new video on Azure Databricks. Today we are...

3rd July, 2019

Read More
Engineering Data Science
Author vector
Terry McCann
A Quick Tour of the Azure Databricks Workspace
Every day this month we will be releasing a new video on Azure Databricks. Today we are...

2nd July, 2019

Read More
Engineering Data Science
Author vector
Terry McCann
What is Azure Databricks?
Every day this month we will be releasing a new video on Azure Databricks. Today we are...

1st July, 2019

Read More
Engineering Data Science
Author vector
Terry McCann
Creating Your First Databricks Workspace
Every day this month we will be releasing a new video on Azure Databricks. Today we are...

1st July, 2019

Read More
Engineering
Author vector
Terry McCann
Introducing the Month of Azure Databricks
Every day this month Advancing Analytics will be delivering a short video on Azure Databricks...

30th June, 2019

Read More
Engineering AI
Author vector
Terry McCann
Advancing Analytics Re-awarded as Microsoft Most Valuable...
We are very pleased to announce that our two directors have been re-awarded as Microsoft Most...

30th June, 2019

Read More
Data Data Science
Author vector
Terry McCann
Setting up #WindowsTerminal for Data Science
Hi everyone, Just a short blog to show you how to get the new Windows Terminal set up for a...

22nd June, 2019

Read More
Chief Data Officer Engineering
Author vector
Simon Whiteley
Should you have an ETL window in your Modern Data Warehouse?
Ah the ETL (Extract-Transform-Load) Window, the schedule by which the Business Intelligence...

20th June, 2019

Read More
Chief Data Officer Engineering
Author vector
Simon Whiteley
Is Kimball Still Relevant in the Modern Data Warehouse?
It’s an emotive question, and probably one that will be as divisive as the Kimball Vs Inmon...

16th June, 2019

Read More
Engineering Events
Author vector
Terry McCann
Modern Data Warehousing with Azure Databricks at the #PASSSummit in...
Hey everyone, Advancing Analytics are heading to Seattle in November for the PASS Summit. We...

9th June, 2019

Read More
Chief Data Officer Engineering
Author vector
Simon Whiteley
Unlock the Value of Data Faster Through Modern Data Warehousing
Data has value – I think we’ve finally got to the point where most people agree on this. The...

9th June, 2019

Read More
Engineering
Author vector
Terry McCann
Introducing our new Director of Engineering!
After an incredible 6 months working with amazing customers on incredible problems the time...

30th May, 2019

Read More
Engineering Data Science
Author vector
Terry McCann
Docker for Data Science: Building a Python Machine Learning Model
Welcome to another blog where we look at Machine Learning in Production. This is an ongoing...

27th May, 2019

Read More
Data Engineering
Author vector
Terry McCann
Azure Databricks. The Blog of 63 questions. Part 6
Co-written by Terry McCann & Simon Whiteley. A few weeks ago we delivered a condensed version...

23rd May, 2019

Read More
Data Engineering
Author vector
Terry McCann
Azure Databricks. The Blog of 60 questions. Part 5
Co-written by Terry McCann & Simon Whiteley. A few weeks ago we delivered a condensed version...

16th May, 2019

Read More
Data Engineering
Author vector
Terry McCann
Azure Databricks. The Blog of 60 questions. Part 4
Co-written by Terry McCann & Simon Whiteley. A few weeks ago we delivered a condensed version...

9th May, 2019

Read More
Data Science
Author vector
Terry McCann
Running Jupyter notebooks in a different folder
When doing demos I am frequently asked how do you point you session of Jupyter Notebooks to a...

6th May, 2019

Read More
Engineering Data Science
Author vector
Terry McCann
Docker for Data Science: Building Web Apps
Building a web application and getting it to run in Docker. If you're a data scientist or Data...

3rd May, 2019

Read More
Data Engineering
Author vector
Terry McCann
Azure Databricks. The Blog of 60 questions. Part 3
Co-written by Terry McCann & Simon Whiteley. A few weeks ago we delivered a condensed version...

2nd May, 2019

Read More
Engineering Data Science DevOps
Author vector
Terry McCann
Docker for Data Science: Getting Started & Installing Docker
In the last Docker for Data Science blog we looked at where Docker came from and why it is...

1st May, 2019

Read More
Engineering Data Science DevOps
Author vector
Terry McCann
Docker for Data Science: Docker Fundamentals
Why do we need Docker? I have worked in software development for a while and in that time I...

30th April, 2019

Read More
Data Engineering
Author vector
Terry McCann
Azure Databricks. The Blog of 60 questions. Part 2
Co-written by Terry McCann & Simon Whiteley. A few weeks ago we delivered a condensed version...

29th April, 2019

Read More
Data Science DevOps
Author vector
Terry McCann
Comparing deployment options for Machine Learning Models in Azure
Last week I delivered a training session on how to deploy machine learning models in Azure. We...

28th April, 2019

Read More
Data Engineering
Author vector
Terry McCann
Azure Databricks. The Blog of 60 questions. Part 1
Co-written by Terry McCann & Simon Whiteley. A few weeks ago we delivered a condensed version...

28th April, 2019

Read More
Podcast Data Science
Author vector
Terry McCann
Data Science In Production Episode 5: Data Lakes for Data Science
Hey Productionaneers, In this podcast we explore the concept of data lakes. Data lakes are a...

27th March, 2019

Read More
Podcast Data Science
Author vector
Terry McCann
Data Science In Production Episode 4: #MLFlow with Matei Zaharia
Hey Productionaneers, In this podcast I was able to catch-up with a tech giant Matei Zaharia....

7th March, 2019

Read More
Data Science
Author vector
Terry McCann
Getting started with #MLFlow in Azure Databricks
MLFlow in Azure Databricks just went in to public preview yesterday. Here is a video which...

7th March, 2019

Read More
Search Here
    Popular Blogs

    10 Incredibly Useful Time Series Forecasting Algorithms

    Azure OpenAI vs OpenAI: What's the Difference?

    What's in a name? Naming your Fabric artifacts

    Vector (45)
    Vector (46) dise