Insights

The Problems With Legacy AML Technology

The Ministers of the Financial Action Task Force (FATF) met for their biannual meeting in Washington D.C on the 18 April 2024, ultimately…

Using AI To Combat Terrorist Financing And Money Laundering

The geopolitical turmoil in recent months is a painful reminder that sanctioned regimes, companies, groups and persons are still able to…

Benjamin Wootton and Pontus Noren Unveil Ensemble AI

We are pleased to announce the launch of Ensemble AI , a professional services business dedicated to helping enterprises deploy and adopt…

How Large Enterprises Can Approach An AI "Transformation"

Though AI has been around for decades, it experienced a massive uptick in interest in November of 2022 with the release of ChatGPT. At…

Using Advanced Analytics To Overcome Challenges In Financial Crime Technology

It is estimated that more than 50% of businesses have been a victim of financial crime , with total global losses amounting to a remarkable…

Calculating Value At Risk For An Equities Portfolio Using ClickHouse

ClickHouse is increasingly being used by capital markets firms such as investment banks, hedge funds and trading technology vendors…

ClickHouse Is The Spiritual Successor To KDB+

In a recent article we explained how ClickHouse is growing in adoption within capital markets businesses such as investment banks, hedge…

Building A Recommendation System Using ClickHouse and SQL

In recent blog posts we demonstrated how data science techniques such as forecasting and anomaly detection can be implemented entirely…

Why Prompt Engineers and LLMOps Engineers Will Become Real Job Titles

When I first heard the term "prompt engineering" I laughed. Surely we didn't need specialist skills to play with ChatGPT? Likewise with…

Introducing EnsembleJS, Our Low Code Framework For Developing Real Time Data Applications

EnsembleJS is our new low-code framework which we use to rapidly develop real-time data applications powered by ClickHouse. It…

Building An Intelligent Agent With AWS Bedrock

In this article we will introduce the powerful agent functionality of AWS Bedrock. We will begin by introducing core concepts, then move…

Solving A Workforce Optimisation Problem With ClickHouse Cloud and Google OR-Tools

In a recent blog post we looked into a data science problem involving optimising how to route delivery vehicles around the country in the…

Optimising Vehicle Routing Using ClickHouse Cloud And Google OR-Tools

Operational Analytics is about using real time data to make better day to day decisions. It involves looking at the state of the world…

Using ClickHouse Cloud As A Real Time Data Warehouse

When you think of data warehouse technology, you may think of legacy on premise offerings such as Oracle or Terradata, or more modern cloud…

Using ClickHouse Cloud To Power ML Feature Stores - A Fraud Detection Example

In a recent blog post we walked through the process of combining AWS SageMaker with ClickHouse to develop and deploy a machine learning…

How ClickHouse Cloud Simplifies Your Data Stack

In recent years, many data teams bought into the modern data stack tooling and philosophy. This involved combining a number of fully…

Open Table Formats Are Inevitable For Analytical Datasets

How open data formats such as Iceberg, Delta and Hudi are a compelling approach for businesses.

Combining Large Language Models With Real Time Data

In this video we explain how large language models can be used to interrogate a real time analytical database, in this case ClickHouse Cloud…

A Real World Business Application Of LLMs and GenAI (Video)

In this video, we demonstrate a real world example of how LLMs can be used in the financial services industry. We're going to be using the…

Transforming Financial Services With Generative AI (Video)

In this video, we demonstrate a real world example of how LLMs can be used in the financial services industry. Our aim was to bring to life…

Why ClickHouse Cloud Is A Good Fit For Machine Learning

Developing machine learning models can require and produce significant amounts of data. This includes training datasets, results of…

Ensemble And QRI Partner To Help Businesses Become More Secure And Compliant

We are pleased to announce our partnership with Quantum Resilience International . QRI are business that specialise in supporting family…

ClickHouse Cloud And Hex Are A Great Stack For Analytics And Data Science

ClickHouse Cloud and Hex are fast becoming our preferred stack for doing data analytics and data science. Together, they provide a fully…

Combining ClickHouse Cloud And AWS SageMaker For Machine Learning

In previous articles, we looked at performing machine learning tasks such as forecasting and anomaly detection directly within…

Integrating Large Language Models With Real Time Analytics (Video)

In this video, we demonstrate how large language models can be integrated with a real time analytical database, in this instance ClickHouse…

Combining Cube And ClickHouse For User Facing Analytics

The high performance of ClickHouse makes it particularly suitable for user-facing analytics use cases. This is where we embed analytics…

Introducing AWS Bedrock, Knowledge Bases And Agents

In this video, we introduce AWS Bedrock, which is a new service for working with large language models (LLMs). We begin by introducing…

Why Cloud Data Warehouses Are Too Expensive For Emerging Data Requirements

ClickHouse recently published an excellent article describing how cloud data warehouses such as Snowflake and Redshift are coming under…

Time Series Classification Using ClickHouse Machine Learning Functions

This article is part of a series where we look at doing data science work within ClickHouse . Articles in this series include forecasting…

Linear Regression Using Clickhouse Machine Learning Functions

This article is part of a series where we look at doing data science work within ClickHouse . Articles in this series include forecasting…

Comparing ClickHouse Cloud With Snowflake Pricing

Introduction In this article we analyse the differences in pricing between Snowflake and ClickHouse Cloud , with the aim of comparing TCO…

Anomaly Detection Using ClickHouse

This article is part of a series where we look at doing data science work within ClickHouse . Articles in this series include forecasting…

Using ClickHouse For Operational Analytics

Forecasting Using ClickHouse Machine Learning Functions

This article is part of a series where we look at doing data science work within ClickHouse . Articles in this series include forecasting…

How We Built A Crypto Analytics Platform Based On ClickHouse

One of our most significant projects with ClickHouse involved developing an analytics platform for Crypto and Web3 data. The aim of the…

Why ClickHouse Cloud Disrupts The Data Warehouse Industry

In recent years, when I have been asked by businesses which data warehouse to choose, there were 3 candidates at the top of the list…

The New Architecture For Cloud Native Data

The architectural patterns for building and managing data warehouses in the cloud are changing dramatically. These changes are likely to be…

Combining dbt And ClickHouse

dbt is a popular open-source tool that is used for defining and running data transformations within data warehouses. Typically, it has…

Using Git Branches And Pull Requests As Part Of Your dbt Workflow

How using source control, Git and branching and merging strategies can improve your data delivery.

Why We Went "All In" On ClickHouse

Historically, enterprise data and analytics systems have been built around batch processing. This involves collecting new data into batches…

Using Multiple Databases For Your dbt Workflow

How introducing multiple databases as part of a dbt deployment improves your data quality.

What Is dbt And Why Is It Such A Game Changer For Data Teams?

How dbt is a simple yet transformative tool for data teams.

How dbt Helps Data Engineers Work Like Software Engineers

How dbt helps Data Engineers adopt practices that have traditionally been used by Software Engineers

Introducing Ensemble CI, A Continuous Delivery Platform For Data Engineers

Introducing Ensemble, a CI/CD platform built specifically for Data Engineers who use dbt.

Introduction To AWS Kinesis

Amazon Kinesis is a cloud-based service from AWS that's essential for real-time data streaming and analysis. Below are its key components:…

From Historical Dashboards To Automated Interventions

Historically, business intelligence initiatives have focussed on providing self service dashboards and reports which are used to surface…

What Is Dash, And How Can It Benefit Your Business?

As we know, many business intelligence are overly focussed on dashboards as the means of disseminating information, and we believe this is…

Why Embedded Analytics Beat Dashboards & Reports

Most Business Intelligence or analytics projects today aim to deliver reports and dashboards as the eventual output. The idea is that…

Why You Need An Orchestrator In Your Data Stack

Data Orchestration platforms such as Airflow, Dagster and Prefect can be used to execute and co-ordinate all of the data related pipelines…

The Risks Of Consumption Based Pricing For Analytics Tools

Broadly, there are three ways to price any subscription software product: Consumption Based - where the price charged is based entirely on…

Real Time Data and Analytics

The vast majority of Business Intelligence and Analytics solutions in place today operate on out-of-date, backwards looking, historical data…

Real Time Closed Loop Analytics

Many companies today are interested in using data to improve their business and customer experience. Most of these initiatives ultimately…

Why OpenTelemetry Has The Potential To Simplify IT Operations

Telemetry is about collecting information from remote sources and bringing it back into a centralised location for analysis and monitoring…

Rise Of The Citizen Data Scientist

Enabling Business Users To Carry Out Their Own Data Science and Analytics

Databricks Structured Streaming Example

Databricks structured streaming is the modern way to work with streaming data in Spark.

Materialised Views On Event Streams

Imagine we have a stream of events representing new orders: Much of the move to event driven architecture is about responding to these…

Using Real Time Data To Guide Employee Next Best Action

There has been a long held concern as to whether “Artificial Intelligence” will ultimately, replace humans en masse in the workforce. For…

Why Event Driven Architecture and Streaming Data Improves Audit & Compliance

Imagine we have a database table of customer details which sits behind a typical web application: Name Address Gender Lifetime Spend Ben…

Big Datas Elephant In The Room

For many years, "Big Data" was a major buzzword in enterprise IT. The theory was that as data volumes grew, we would need different…

How Moving From Batch To Real Time Data Integration Improves The Customer Experience

Over time, the typical business acquires more and more applications. Some will be bespoke, some off the shelf, some cloud hosted SaaS tools…

Is Your Procurement Department Throttling Your Ability To Innovate?

Big Corp Enterprise LTD are in the business of making widgets. They are a huge business and have led their industry for decades. However…

Moving From Batch To Streaming Extract, Transform and Load

There are many situations in Enterprise IT where we need to move, copy or integrate datasets. For example, populating a centralised data…

Why Serverless Is The Future For Data & Analytics Platforms

In the bad old days, the first step when building a database, analytics or business intelligence solution would be to order or provision a…

Moving Towards Real Time Data & Analytics

As your business operates day to day, a number of events are taking place. Examples include orders, dispatches, customer enquiries or…

From Titanic Releases To 10,000 Speedboats With Continuous Delivery

Does your software release process look anything like this.... Releases are big events marked months ahead on the calendar; A lot of…

Step Away From The Dashboard

The humble dashboard is limiting the potential of what businesses achieve with data and analytics. The idea of a dashboard always sounds…

Three Areas Of Opportunity With Data and Analytics

Data and analytics are crucial for businesses who are looking to make better decisions, operate more efficiently and build great employee…

In Business, Everything Is An Event

Imagine a simple customer interaction for an eCommerce business: A customer visits the website and browses various products; A few days…

From Strategic To Operational Analytics

Historically, businesses have used their data and analytics over strategic time horizons. For instance, collecting information about what…

Our Approach and Partnership Model

Ensemble are a new professional and managed services firm who help companies build sophisticated real-time data and analytics solutions…

Why We Launched Ensemble

Data and analytics are a huge enabler for businesses who are looking to make better decisions, operate more efficiently and build great…

Analysing FIX Logs With ClickHouse

ClickHouse is gaining more and more market share in the capital markets industries. It's combination of high speed. We have previously…

FinCrime Draft - From Rule Based To Behavioural Analysis

Traditionally, financial institutions use rule based systems to monitor for situations which could be indicative of a financial crime or…

FinCrime Draft - How Is The Nature Of Financial Crime Changing

Those wanting to commit serious financial crime or violate sanctions programs will continue to use methods we are all familiar with. For…